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SUMMARY 

This  research  considers  the  analysis  of  training  effects  in  op- 
erational test  and  evaluation.  Previous  analysis  of  weapons  system  ef- 
fectiveness highlights  the  importance  of  including  training  effects  in 
any  evaluation  of  a weapons  system.  Computer  simulation  is  proposed  as 
a method  of  extending  the  scope  of  operational  testing  into  areas  for 
which  it  is  not  feasible  to  test  in  an  operational  test.  The  mutually 
supporting  nature  of  computer  simulations  and  operational  tests  are 
discussed . 

Utilization  of  computer  simulation  facilitates  the  derivation  of 
multiple  response  surfaces  relating  weapons  system  effectiveness  to 
training  related  variables.  The  research  adapts  the  Geof frion-Dyer 
Interactive  Vector  Maximal  algorithm  into  a methodology  for  the  optimi- 
zation of  multiple  response  surfaces.  Application  of  the  methodology 
to  multiple  response  problems  previously  solved  in  the  literature  is 
performed  with  results  which  compare  favorably  to  the  original. 

A hypothetical  analysis  of  the  effects  of  training  on  the  effec- 
tiveness of  a new  main  battle  tank  is  described  in  detail.  The  method- 
ology is  utilized  to  optimize  four  objective  response  functions  which 
are  functions  of  training  variables.  Utilization  of  the  methodology  re- 
sults in  an  improved  training  program  for  test  personnel,  in  a detailed 
analysis  of  the  effects  of  training  on  the  effectiveness  of  the  new 
tank,  and  in  the  inclusion  of  this  analysis  in  the  operational  test 


reports. 
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INTRODUCTION 

Overview:  Operational  Testing 
Structure  of  the  Major  Defense  Systems  Acquisition  Process 

The  large  sums  of  federal  moneys  expended  on  major  defense  systems 
acquisition  necessitate  a highly  structured  and  well  safeguarded  proce- 
dure. Both  the  Department  of  Defense  and  the  Department  of  the  Army 
utilize  such  a procedure  in  their  acquisition  processes.  The  procedure 
is  designed  to  insure  acquisition  of  only  those  major  systems  for  which  a 
valid  need  exists  within  the  defense  establishment.  Department  of  Defense 
directives  document  the  acquisition  process  and  its  procedures  in  great 
detail  (60,63,64). 

The  acquisition  cycle  of  a major  Army  system  is  comprised  of  six 
phases.  The  first  phase  is  a determination  by  the  Army  staff  that  a valid 
requirement  exists  for  the  addition  of  the  system  to  the  active  inventory. 
A Required  Operational  Capability  (ROC)  report,  containing  a statement  of 
need  and  conceptual  approach,  is  approved  and  issued  by  Department  of  the 
^ Army  (50).  Next  is  the  conceptual  development  phase  during  which  the 

( system's  hardware  is  in  an  experimental  prototype  configuration.  The 

third  phase  is  the  validation  phase  in  which  the  system's  hardware  is  in 
engineering  development  prototype  configuration.  Next  is  the  Jevelopment 
phase  during  which  the  system's  hardware  is  in  a production  prototype 
configuration.  The  fifth  and  sixth  phases  are,  respectively,  full  pro- 
duction and  deployment  of  the  system  to  tactical  units  (60). 
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After  issuance  of  the  ROC,  the  Secretary  of  Defense  roust  grant 
approval  for  the  system  to  move  to  each  of  the  next  phases.  The  decision 
options  available  to  the  Secretary  of  Defense  are  to  terminate  the  sys- 
tem, to  permit  the  system  to  proceed  to  the  next  phase,  or  to  retain  the 
system  in  its  present  phase  for  remedial  action.  To  provide  information 
and  recommendations  to  the  Secretary  of  Defense  at  these  decision  points, 
a permanent  advisory  body,  the  Defense  Systems  Acquisition  Review  Council 
(DSARC) , has  been  created.  Membership  of  the  DSARC  includes  the  Deputy 
Secretary  of  Defense  and  Assistant  Secretaries  of  Defense  within  areas 
of  responsibility  pertinent  to  the  system  under  consideration.  A meeting 
of  the  DSARC  preceeds  each  decision  point  (64) 

There  exists  a parallel  acquisition  structure  within  the  Depart- 
ment of  the  Army.  The  Army  Systems  Acquisition  Review  Council  (ASARC) 
has  been  created  as  a permanent  advisory  body  to  provide  the  Army's  re- 
commendation at  each  phase  of  the  acquisition  process  to  the  DSARC. 

The  ASARC  is  chaired  by  the  Vice  Chief  of  Staff  of  the  Army.  Its  mem- 
bership includes  the  Commander  of  the  U.  S.  Army  Material  Command,  the 
Commander  of  the  U.  S.  Army  Training  and  Doctrine  Command,  the  Chief  of 
Research,  Development,  and  Acquisition,  and  pertinent  Assistant  Secre- 
taries of  the  Army.  To  fulfill  the  requirement  of  advising  the  DSARC, 
the  ASARC  schedules  meetings  prior  to  those  of  the  DSARC.  The  principle 
of  civilian  control  over  the  military  is  upheld  throughout  the  systems 
acquisition  cycle  by  the  requirement  of  affirmation  by  the  Secretary 
of  Defense  at  each  phase  transition  (60). 

Testing  in  the  Acquisition  Process 
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Testing  of  a major  system  is  conducted  throughout  the  acquisition 
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process  to  determine  whether  the  system  Is  satisfying  technical  and 
operational  requirements.  Acquisition  testing  is  divided  into  two  cate- 
gories: a Development  Test  (DT)  and  an  Operational  Test  (OT) . The  DT 
and  OT  have  diverse  objectives.  The  objective  of  the  DT  is  to  determine 
whether  the  engineering  design  and  development  process  is  complete,  to 
determine  whether  the  design  risks  have  been  minimized,  and  to  determine 
whether  the  system  will  meet  its  specifications.  The  objective  of  the 
OT  is  to  estimate  the  system’s  military  worth  in  comparison  with  compet- 
ing systems,  to  estimate  its  operational  effectiveness  and  suitability 
in  its  environment,  and  to  determine  whether  the  system  required  modi- 
fication (60). 

Three  distinct  DT's  and  OT's  are  usually  conducted  during  the 
acquisition  process.  The  scheduled  meetings  of  the  ASARC  are  preceded 
by  a DT  and  an  OT.  Results  of  the  DT  and  OT  are  reported  to  the  ASARC 
for  Inclusion  in  the  report  to  the  DSARC.  To  provide  additional  safe- 
guards and  validation,  the  DT  and  OT  are  conducted  totally  Independent  of 
each  other  (60).  Only  the  OT  will  be  of  interest  in  this  research.  Se- 
quencing of  the  acquisition  process  is  graphically  depicted  in  Figure  1. 
Operatinal  Testing 

Responsibility  for  the  conduct  of  the  OT's  on  major  defense  sys- 
tems within  the  Department  of  the  Army  has  been  delegated  to  the  U.S. 

Army  Operational  Test  and  Evaluation  Agency  (OTEA) . OTEA  is  independent 
of  the  developing,  procuring  and  using  agencies  or  organizations.  The 
mission  of  OTEA  is  to  support  the  material  acquisition  and  force  develop- 
ment processes  by  exercising  responsibility  for  all  OT’s,  managing  force 
development  testing  and  experimentation,  and  managing  joint  user  testing 
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for  the  Army.  In  an  effort  to  stress  military  usage  of  the  tested  sys- 
tem, the  OT  is  conducted  utilizing  typical  user/operators,  crews,  or 
units  in  as  realistic  an  operational  environment  as  possible.  OT's  are 
conducted  throughout  the  world  by  several  diverse  testing  and  tactical 
units.  The  objective  of  the  OT  is  to  provide  the  data  necessary  to 
estimate: 

1.  The  military  utility,  operational  effectiveness,  and  operational 
suitability  of  the  system. 

2.  The  system's  desirability,  considering  systems  already  in 
service  (base-line  systems)  and  other  competing  systems,  and  the  system's 
operational  advantages  and  disadvantages  from  the  user's  perspective. 

3.  The  need  for  modification  of  the  system. 

4.  The  adequacy  of  doctrine,  organization,  operating  techniques, 
tactics,  and  training  for  system  deployment. 

5.  The  adequacy  of  maintenance  support  for  the  system. 

6.  The  system's  performance  in  a countermeasures  environment. 

An  independent  evaluation  of  each  OT  is  prepared  by  OTEA  and  sub- 
mitted to  the  ASARC.  An  emphasis  is  placed  on  a comparison  of  the  pro- 
posed system,  base-line  systems,  and  competing  developmental  systems. 
Feedback  from  the  ASARC  and  DSARC  is  utilized  to  modify  future  OT' s . (61 ,62) . 
Computer  Simulation  in  Operational  Testing 

Computer  simulation  is  finding  wide  application  as  a predictive 
and  investigative  tool.  Most  major  defense  systems  undergo  a computer 
simulation  in  a tactical  environment  both  before  and  after  the  issuance 
of  the  ROC.  Simulation  can  provide  useful  pre-test  and  post-test  infor- 
nuition  for  each  OT.  An  important  consideration  is  that  computer  Simula- 
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tlons  and  OT's  are  mutually  supporting.  OT's  provide  verified  data  in- 
puts for  the  simulation.  In  return  the  simulation  provides  predictions 
of  input  data  for  OT's  or  further  investigates  OT  output  data. 

Pre-test  computer  simulation  can  enhance  the  OT  in  three  basic 

areas : 

1.  Examine  the  identified  critical  operational  issues  to  assess 
their  significance. 

2.  Develop  or  discover  critical  operational  issues  that  have 
been  overlooked. 

3.  Provided  a sensitivity  analysis  to  indicate  the  accuracy  re- 
quired of  each  measurement  (50). 

This  information  will  be  obtained  at  relatively  little  cost  and  with  the 
utilization  of  no  test  troops  or  equipment.  The  OT  will  be  initialized 
with  useful  information  and  critical  operational  issues  will  be  verified 
or  identified.  Data  requirements  in  the  test  plan  will  be  refined. 

Post-test  computer  simulation  can  contribute  to  the  success  of  an 
OT  in  the  following  four  areas: 

1.  Constraining  the  scope  of  operational  field  tests  to  manage- 
able proportions  by  providing  analytical  means  for  test  extension. 

2.  Extending  the  OT  into  areas  which  are  currently  infeasible 
(such  as  two-sided  combat). 

3.  Corroborating  the  impact  of  the  OT  results. 

A.  Supplying  much  needed  operational  performance  Inputs  to 
other  agencies  utilizing  simulation  (50). 

OT  results  can  be  combined  with  simulation  results  to  fulfill  the  strin- 
gent requirements  of  statistical  design  of  experiment  methodology  analysis. 
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OT  results  can  be  utilized  as  input  for  simulations  of  combat  in  real 
time  events,  thereby  eliminating  rest  or  safety  time  lags.  Simulation 
can  be  utilized  as  an  independent  evaluation  of  an  OT,  thereby  providing 
an  additional  safeguard  to  the  acquisition  process. 

Training  in  Operational  Testing 

The  relationship  between  systems  effectiveness  and  crew/unit 
training  has  recently  began  to  receive  increased  emphasis  in  the  Depart- 
ment of  the  Army.  There  are  a variety  of  reasons  for  this  increased 
interest.  Establishment  of  the  U.  S.  Army  Training  and  Doctrine  Command 
(TRADOC)  has  institutionalized  the  importance  of  training  and  doctrine 
by  fixing  responsibility  at  a high  level  of  the  Army  command.  Without 
the  troop  and  equipment  demands  of  a belligerent  theater,  the  main  mission 
of  the  Army  transforms  to  training  for  the  next  belligerency.  The  as- 
cending cost  of  systems  combined  with  a federal  budget  squeeze  necessi- 
tates increased  combat  effectiveness  from  fewer  weapons.  As  previewed  in 
the  lecent  Mid-East  conflict,  the  sophistication  and  lethality  of  weapons 
systems  on  either  side  dictates  a rapid,  deadly,  and  decisive  first  en- 
counter in  any  future  conflict.  The  results  of  these  factors  is  increased 
interest  in  training. 

TRADOC  is,  of  course,  the  major  proponent  of  training  in  the  Army. 
Within  the  last  year,  operations  research  analysts  at  TRADOC  have  been 
examining  training  and  weapons  system  effectiveness.  A general  model  of 
systems  effectiveness  has  been  derived. 

E » f(w,p,t)  (1.1) 

where  E is  combat  effectiveness  expressed  as  a function  of  w the  perfor- 
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mance  capability  of  the  system,  p the  proficiency  of  the  crew/unit  manning 
the  system,  and  t the  tactic  or  technique  of  employment.  Various  DT  re- 
sults, such  as  those  obtained  by  the  Army  Material  Systems  Analysis 
Agency  (AMSAA),  can  be  utilized  to  measure  and  quantify  w.  Results  of 
ox's  conducted  by  OTEA,  can  also  be  utilized  in  determining  w (59). 

Some  inconsistencies  arise  in  the  consideration  of  p in  Equation 
1.1.  A Department  of  Defense  directive  states  that,  "Operational  Test 
and  Evaluation  will  be  accomplished  by  operational  and  support  personnel 
of  the  type  and  qualification  of  those  expected  to  use  and  maintain  the 
system  when  deployed". (50)  Most  OT's  are  conducted  with  troops/units  se- 
lected to  satisfy  this  directive  and  then  trained  either  by  the  unit  or 
Equipment  Training  Team  in  accordance  with  a training  package  prepared 
by  OTEA  and/or  TRAEKDC.  Training  is  accomplished  at  home  station,  at  the 
test  site,  and  at  Military  Occupational  Specialty  (MOS)  producing  schools 
if  required  (50).  Having  undergone  such  well  supervised  and  concentrated 
training,  it  is  not  unreasonable  to  assume  that  the  test  personnel  are 
atypical  of  Army  users  in  proficiency  on  the  system. 

Another  inconsistency  in  Equation  1.1  is  the  effect  of  the  learning- 
forgetting  curve  on  proficiency.  Figure  2 depicts  the  influence  of  a 
training  season,  that  is  a period  of  concentrated  training  in  a specific 
area,  on  proficiency  followed  by  a forgetting  slump.  The  training  cycles 
of  most  tactical  units  approximate  such  a curve.  Table  1 quantifies  the 
effect  of  the  forgetting  curve  among  Infantry  trainees  (59). 

The  weapons  system  effectiveness  utilized  by  the  ASARC  and  DSARC 
is  that  obtained  from  the  DT  and  OT.  Equation  1.1  states  that  the  afore- 
mentioned variation  in  actual  user  proficiency  will  cause  variation  in 
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Figure  2,  The  Learning-Forgetting  Curve. 
From  TRADOC  (59). 


Table  1.  Quantified  Effect  of  the  Learning-Forgetting  Curve. 
From  TRADOC  (59) 


Marksmanship  Proficiency 


AVERAGE 

NUMBER  OF  WEEKS 

QUALIFICATION 

IN  THE  ARMY 

SCORE  OBTAINED 

4-5 

52 

14-16 

44 

24-52 

*30 

*1  point  above  unqualified 


systems  effectiveness.  Figure  3 depicts  the  Probability  of  Hit  and  Kill 
of  a system  versus  Range.  Note  the  Performance  Gap  between  AMSAA  data 
(E  ) and  actual  performance  in  the  hands  of  tactical  troops  (E  ) as  pre- 

U A 

dieted  by  Equation  1.1.  This  predicted  Performance  Gap  has  been  verified 
in  actual  weapons  test.  In  May  1974,  the  U.  S.  Army  Infantry  Board 
(USAIB)  test  fired  the  M72A2  Light  Antitank  Weapon  (LAW)  against  moving 
targets  at  varying  ranges.  The  Performance  Gap  uncovered  by  this  test  is 
shown  in  Figure  4 (59).  The  major  problem  encountered  by  the  troops  was  a 
lack  of  proper  training  on  the  graduated  lead  sight  for  a moving  target. 

The  implications  of  these  variations  in  combat  effectiveness  for 
the  national  defense  posture  are  profound.  Figure  5 exhibits  the  varying 
levels  of  Systems  Total  Combat  Power  for  a given  inventory  level  N as  a 
function  of  systems  effectiveness.  The  effectiveness  levels  graphed  are 
E^  the  actual  current  level,  the  designed  effectiveness  level,  and  E^ 
the  optimum  or  maximum  level  (59).  It  is  imperative  that  OTEA,  functioning 
as  a major  source  of  data  on  weapons  systems  effectiveness  to  high  level 
decision  bodies,  account  for  training  levels  in  their  OT  reports  and 
analysis. 


Objective,  Procedure,  and  Scope 

The  objective  of  this  research  is  to  develop  an  improved  methodo- 
logy for  optimizing  a set  of  operational  test  and  evaluation  performance 
measures  which  are  functions  of  training.  The  research  will  consist  of 
a review  and  adaptation  of  response  surface  methodology,  multiple  response 
surface  optimization,  and  multiple  objective  optimization  to  the  problem. 
The  Geof frion-Dyer  Interactive  Vector  Maximal  algorithm  will  then  be  re- 
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Figure  5.  System  Total  Combat  Power  at  Varying  Effectiveness. 

From  TRADOC  (59). 

viewed  in  detail  and  adapted  to  the  multiple  response  problem.  The 
adapted  algorithm  will  then  be  applied  to  previously  optimized  multiple 
response  surfaces  to  demonstrate  its  utility. 

Multiple  response  surfaces  and  the  adapted  optimization  algorithm 
will  be  related  to  OTEA  by  use  of  the  AMSAA  Tank  Duel  Model  computer 
simulation.  The  military  application  will  consider: 

1.  The  extension  of  an  OT  through  computer  simulation. 

2.  The  effect  of  training  on  tested  system  effectiveness. 

3.  The  optimization  of  pre-test  and  tactical  unit  training  pro- 
grams concerning  the  tested  system  when  confronted  with  multiple  objec- 
tives or  criteria. 


4.  The  role  of  the  military  decision  maker  in  the  interactive 


13 


optimization  process. 

The  scope  of  this  research  will  be  limited  by  four  constraints. 

All  data  values  utilized  in  this  research  are  "best  guess"  hypothetical 
values  which  cannot  necessarily  be  inferred  to  be  realistic.  For  demon- 
stration purposes,  only  one  tactical  scenario  is  analyzed  with  the  AMSAA 
simualtion.  The  simulation  is  suited  for  various  scenarios.  The  tacti- 
cal scenario  is  two  opposing  tanks,  in  the  open,  at  a range  of  1000  meters, 
sighting  each  other  simultaneously.  Only  mean  time  to  fire  the  first 
round,  mean  time  between  subsequent  rounds,  and  probability  of  sensing 
fired  rounds  are  assumed  to  be  functions  of  crew  training.  All  other 
variables  are  assumed  to  be  functions  of  the  tested  weapon  system  capa- 


bilities. 
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CHAPTER  II 

REVIEW  OF  MULTIPLE  RESPONSE  SURFACE  THEORY  AND  OPTIMIZATION 

Response  Surface  Methodology 

Response  surface  methodology  is  a collection  of  statistical  and 
matiieraatical  techniques  to  approximate,  utilizing  designed  experimenta- 
tion, an  unknown  and  complex  function,  say 

where  n is  the  dependent  response  variable  and  Sj^.i  = 1.2,...,k,  are  the 

independent,  controllable  natural  variables.  The  approximating  model  is 

usually  a low  order  polynomial,  such  as  a first  order  model 

k 

^ ^ (2.2) 

i = 1 


or  a second  order  model 


k 1^  k k 

^ = ^0  ^ Z ^^i  + Z ^ii^  21  Z ^ (2.3) 

i = l i = l i = lj  = l 

i < j 

In  these  models  the  x^,i  = 1,2, ...,k,  are  design  variables,  coded  within 
a region  of  experimentation  for  computational  simplification  by 


X 


in 


r 


(2.4) 
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wliere  C.  is  the  u th  level  of 

lu  1 


^1  ■ I 


u = 1 


and 


N 

z «. 

0 1 



1 N 


(2.5) 


Three  fundamental  assumptions  are  involved  in  response  surface  methodology: 

1.  The  structure  n = f (x^ , x^, . . . , x^)  exists  and  is  either  very 
complicated  or  unknown.  The  variables  involved  are  quantitiati ve  or  con- 
t inuous . 

2.  The  function  f can  be  approximated  in  the  region  of  interest 
by  a low  order  polynomial  such  as  Equation  2.2  or  2.3. 

3.  The  independent  variables  , x^ , . . . , x^^  are  controlled  in  the 

data  collection  process  and  measured  with  negligible  error  (47). 

Optimization  of  a response  surface  begins  with  a search  for  the 
region  of  maximum  response.  Initially  a first  order  fitted  response  func- 
tion, 

k 

y = bo  + X b.x.,  (2.6) 

i = 1 


is  fitted  to  a region  of  experimentation.  This  fitting  is  accomplished 
through  the  use  of  statistically  designed  experiments  and  least  squares 
regression.  Generally  orthogonal  designs  are  used  to  fit  the  first  order 
model,  since  they  greatly  simplify  computations  and  yield  uncorrelated 
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estimates  of  the  response  model  coefficients.  Next  the  response  is  im- 
proved by  moving  along  the  path  of  steepest  ascent.  Using  LaGrange 
Multipliers  to  maximize  Equation  2.6  subject  to 

k 

i = 1 


results  in 


Xj  = hj2v  (j  = 1,2,.. .,k)  (2.8) 

where  u is  a conveniently  selected  increment  along  the  path.  Equation 
2.8  yields  an  initial  point  of  experimentation  for  each  design  variable 
along  the  path  of  steepest  ascent.  A search  is  conducted  along  the  path 
until  an  optimum  response  is  reached.  Addition  of  center  points  to  the 
first  order  design  at  this  improved  point  will  permit  a formal  analysis 
of  variance  and  a test  for  lack  of  fit.  Should  these  reveal  significant 
lack-of-fit  for  the  first  order  fitted  response  function  or  should  the 
path  of  steepest  ascent  yield  minimal  improvement,  the  experimenter 
usually  fits  a second  order  response  function. 

Second  order  fitted  response  functions  are  of  the  form 

k k k k 

y = V ^ ^ 2 ‘’ijVj  ^ \i^  ^2.9) 

i = l i = lj  = l i = l 

i < j 

There  is  a considerable  amount  of  theory  on  the  choice  of  design  to  fit 
Equation  2.9.  Consideration  is  given  to  the  bias  of  the  predicted  re- 


sponse or  the  variance  of  the  predicted  response.  Uniform  Precision  and 
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Orthogoaal  Rotatable  Central  Composite  Designs  have  received  the  greatest 
use  in  practice.  A Central  Composite  Design  (CCD)  is  well  suited  to  the 
methodology  since  it  is  comprised  of  the  first  order  orthogonal  design 
and  the  addition  of  axial  points  outside  the  first  order  design  region 
of  experimentation.  A Rotatable  Design  is  defined  to  be  a design  in 
which  the  variance  of  the  estimated  response  is  a function  only  of  dis- 
tance from  the  center  of  the  design  and  not  of  the  direction  from  the  cen- 
ter. A Uniform  Precision  Design  is  defined  to  be  a design  in  which  the 
precision  of  y. 


p(y) 


NVar (y) 

2 

o 


(2.10) 


at  the  design  center  is  equal  to  the  precision  at  a radius  p - 1.  Philo- 
sophically, this  means  that  the  estimated  response  receives  uniform  im- 
portance with  the  region  p = 1.  Table  2 depicts  the  choice  of  number  of 
first  order  design  points  (F),  axial  points  (n  ),  center  points  (n-), 

di 

total  points  (N) , and  displacement  distance  of  axial  points  (a)  for  Uni- 
form Precision  (up)  and  Orthogonal  Rotatable  CCD  (ortho)  of  a varying  num- 
ber of  unknown  (k)  (A7). 

Once  a design  has  been  selected  and  the  data  collected,  least 
squares  regression  is  performed  to  yield  Equation  2.9.  An  ANOVA  and  lack- 
of-fit  test  is  then  conducted.  If  there  is  significant  lack-of-flt,  the 
experimenter  can  either  fit  a higher  order  response  function  or  adjust  his 
region  of  experimentation  until  the  second  order  response  function  is 
adequate.  Equation  2.9  can  also  be  expressed  in  matrix  notation  as 

y “ bp  + x'b  + x'Bx 


(2.11) 
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Table  2.  Uniform  Precision  and  Orthogonal  Rotatable  Central 
Composite  Designs.  From  Myers  (A""). 


k 

2 

3 

4 

5 

5 

5 rep 

6 

6 

( rep 

7 

) rep 

8 

( rep 

F 

4 

8 

16 

32 

16 

64 

32 

64 

128 

«a 

4 

6 

8 

10 

10 

12 

12 

14 

16 

(up) 

5 

6 

7 

10 

6 

15 

9 

14 

20 

(orih) 

8 

9 

12 

17 

10 

24 

15 

22 

33 

S (up) 

13 

20 

31 

52 

32 

91 

53 

92 

164 

N (orlli) 

16 

23 

36 

59 

36 

100 

59 

1(X) 

177 

1.414 

1.682 

2.000 

2.378 

2.(KX) 

2.828 

2.378 

2.828 

3.364 

■(4  (up) 

0.81 

0.86 

0.86 

0.89 

0.89 

0 91 

090 

0.92 

0.93 

I4  (ort(i) 

1.00 

0.99 

1.00 

I.OI 

l.(X) 

1.00 

1.01 

l.(X) 

0.998 

where 


X = 

^1 

. b = 

"2 

, B = 

*’11  ^12^^ 

22  ;;; 

•••  \-i,k^2 

\k 

k2.ii) 


Elementary  calculus  optimization  of  Equation  2.11  yields  an  estimated 
point  of  maximum  response,  termed  the  stationary  point,  given  by 

= -B~K/2  (2.12) 

The  stationary  point  can  lie  inside  or  outside  the  region  of  experimenta- 
tion. It  is  not  advisable  to  extrapolate  the  response  function  outside 
the  region  of  experimentation. 

When  analyzing  a multiple  response  system,  the  extrapolation 
caveat  assumes  great  Importance.  If  the  optima  of  all  responses  are  in 
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one  region  of  experimentation  there  is  no  cause  for  concern.  If  second 
order  response  equations  cannot  be  fitted  for  all  response  in  the  same 
region  of  experimentation,  two  courses  of  action  are  available.  First, 
the  experimenter  may  choose  a primary  response  and  utilize  its  region  of 
experimentation  to  fit  first  order  models  to  those  responses  which  are 
not  optimum  in  the  chosen  region.  Second,  the  experimenter  may  choose  a 
compromise  region  of  experimentation  between  the  optima  and  fit  first 
order  models  for  the  responses  in  this  region.  One  must  be  careful  not 
to  extrapolate  for  any  response  outside  its  region  of  experimentation. 

To  facilitate  interpretation  of  the  second  order  fitted  response 
function,  the  experimenter  can  perform  a canonical  analysis.  Initially 
the  response  function  is  translated  from  the  origin  to  the  stationary 

point.  Next  the  axes  are  rotated  to  correspond  to  the  principle  axes  of 

response  surface.  To  translate  Equation  2.11  to  origin  3^^,  the  trans- 
formation 

z = x-2^j  (2.13) 

is  made  resulting  in 

y “ b.  + x^  + x!B3^  + z'b  + z'Bj^  + ^'Bz  + z'Bz.  (2.14) 

U ”1^  — — — — ^ — — — 

By  defining  the  estimated  response  at  the  stationary  point  as 

yO-bo+x^b/2,  (2.15) 

Equation  2.14  becomes 

y = yQ  + £'B£. 


(2.16) 
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An  orthogonal  transformation, 


z = Mw, 


(2.17) 


is  then  made  such  that 


= w ' M ' BMw 


, 2 


(2.18) 


where  i l,2,...,k,  are  the  eigenvalues  of  matrix  B.  By  substitution 
of  Equations  2.14,  2.16,  and  2.18  the  canonical  form  of  Equation  2.11  is 

k 

y = yo  + Z (2.19) 

i = 1 

Interpretation  of  the  response  function  is  based  on  the  A^  of 
Equation  2.19.  If  all  the  A^  are  negative,  is  a maximum  as  depicted 
in  Figure  6(a).  If  all  the  A^  are  positive,  3^  is  a minimum.  If  the  A^ 
have  different  signs,  the  stationary  point  lies  in  a saddle  region,  as 
shown  in  Figure  6(b),  and  possibly  indicates  the  existence  of  two  maxima. 

If  one  A is  extremely  small,  the  surface  is  a stationary  ridge,  as  de- 

‘ j 

picted  in  Figure  6(c),  with  a range  of  possible  variable  combinations 
yielding  an  approximately  optimum  response.  Should  3^  lie  outside  the 

I 

region  of  experimentation,  the  surface  approaches  the  shape  of  a rising  j 

i 

ridge  as  shown  in  Figure  6(d).  The  relative  magnitudes  of  the  A^  indi-  I 

1 

cates  elongation  or  contraction  of  the  response  surface  in  various  dl-  j 

rections.  Figure  7 shows  various  response  surfaces  for  the  three  inde-  j 
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Figure  6.  Response  Surfaces  Generated  by  a Second  Degree  Equation 

With  Two  Independent  Variables.  Note:  x in  this  figure 
is  equivalent  to  in  the  text.  From  Box^(lO) 


g 


Figure  7 
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Response  Surfaces  Generated  by  a Second  Degree  Equat 
With  Three  Independent  Variables.  Note:  x in  this 
is  equivalent  to  X in  the  text.  Figures  a^ove  have 

following  X : (a)^ or  +++,  (b)  —0,  (c)  — h,  (d) 

(3)  -0+,  (fj  -00  3^  at  »,  (g)  ~0  X at  ®.  From  Box 
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f igure 
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-00, 
(10). 
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pendent  variable  case. 

The  foregoing  review  of  response  surface  methodology  is  intended 
to  familiarize  the  reader  with  concepts  utilized  in  Chapter  IV  of  this 
research.  Should  the  reader  desire  additional  information  on  the  subject, 
the  text  by  Myers  (A7)  is  recommended  as  a definitive  work. 

Multiple  Response  Surface  Optimization  Literature  Survey 

In  many  practical  applications  of  response  surface  methodology, 
more  than  one  response  function  is  generated  by  the  independent  variables. 
For  instance,  a chemical  reaction  with  independent  variables  such  as  a- 
mount  of  reactants,  temperature,  and  pressure  may  have  multiple  response 
functions  such  as  purity,  amount  of  yield,  and  cost.  Each  response 
function  will  be  in  the  form  of  Equation  2.6  or  2.9.  Confronted  with 
multiple  response  functions,  the  decision  maker  cannot  apply  simple  uni- 
function optimization.  Research  on  multiple  response  surface  optimization 
was  rather  sparse  prior  to  the  development  of  mathematical  programming 
methodology.  Each  contribution  to  mathematical  programming  is  ensued  by 
its  application  to  multiple  response  surface  optimization.  Thus  far,  the 
efforts  seem  to  divide  into  two  classes  which  could  be  termed  multiple 
objective  optimization  and  constrained  single  objective  optimization. 

Initial  efforts  were  directed  toward  the  graphical  optimization 
of  multiple  response  surfaces.  Box  (18),  in  1954,  cites  an  example  of  a 
chemical  reaction  where  two  reactants,  A and  B,  formed  a mixture  of  C and 
D.  The  objective  was  to  maximize  C while  constraining  D to  be  less  than 
20%.  Canonical  analysis  indicated  that  C was  maximized  along  a plane  of 
68%  yield,  as  shown  in  Figure  8.  A second  response  function  was  derived 
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for  D and  set  equal  to  20%.  As  shown  in  Figure  9,  the  constraint  response 
function  was  superimposed  on  the  maximum  yield  plane,  allowing  a visual 
choice  of  an  optimum  operating  point.  Box  (10)  also  recognized  that  ridge 
systems,  offering  a wide  choice  of  independent  variable  settings  with 
minimal  effect  on  the  dependent  response,  are  extremely  useful  in  this 
type  of  optimization.  For  a three  variable  system,  he  shows  a three  di- 
mensional grid  which  could  display  contours  and  assist  in  visual  optimi- 
zation. Line  (42)  refined  this  technique  by  use  of  acetate  plates  with 
the  response  surfaces  drawn  on  them.  Two  articles  by  Hunter  (35,36),  in 
1956,  also  describe  graphical  analysis  as  an  optimization  technique. 

As  mathematical  programming  methodology  was  developed,  its  appli- 
cation to  response  surfaces  was  obvious.  Schrage  (53),  in  1957,  utilized 
linear  programming  to  assist  in  optimization  of  a Catalytic  Cracking  oper- 
ation. The  gradient  of  the  objective  response  was  maximized  in  the  pres- 
ence of  the  gradients  of  constraint  responses  and  bounds  on  the  indepen- 
dent variables.  This  optimum  direction  was  then  followed  in  the  steepest 
ascent  search.  Linear  programming  could  be  utilized  since  the  gradients 
of  second  order  response  functions  are  linear. 

Quadratic  response  surfaces  were  optimized  directly  by  Umland  and 
Smith  (57),  in  1959,  through  the  use  of  LaGrange  Multipliers.  Yield, 
Equation  2.20,  was  selected  as  the  primary  response  and  maximized  con- 
strained by  fixed  maximum  values  of  the  secondary  response  purity. 

Equation  2.21. 

y^  = 55.84  + 7.31xj^  + 26.65x2-3.03x^-6.96x2  + 2.69x^X2  (2.20) 
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Figure  8.  Yield  Planes  of  Box  Experiment 
From  Davies  (18) 


Superimposition  of  Constraint  Response  on  Primary  Response  in 
Box  Experiment.  From  Davies  (18) 
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y = 85.72  + 21.85X  + 8,59x  -9.20x^-5.18x^-6.26x,x 

S ^ Z X Z X ^ 


(2.21) 


The  response  surfaces  are  graphed  in  Figure  10  and  results  are  listed  in 


Figure  10.  Umland-Smith  Response  Surfaces 
From  Umland  and  Smith  (57). 

Table  3.  By  setting  the  secondary  response  equal  to  maximum  values, 
equality  constraints  are  created.  In  1963  Michaels  and  Pengilly  (A3) 
also  utilized  LaGrange  Multipliers  to  achieve  maximum  yield  constrained 
by  a fixed  maximum  cost  function.  The  cost  function  was  algebaically  de- 
rived. Chow  (16)  demonstrated  that  the  same  technique  could  be  utilized 
with  inequality  constraints.  He  also  simplified  the  computational  pro- 
cedure by  eliminating  the  need  to  solve  a set  of  simultaneous  equations 


through  use  of  a transformation. 

Hoerl  (34),  in  1959,  introduced  two  techniques  to  the  literature. 
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Table  3.  Umland-Smlth  Optimization  Results. 

Purity  94.87  92.47  89.995 

Maximum  95.0  92.5  90.0 

Yield  83.66  86.73  88.68 

0.965  1.005  1.075 

1,088  1.316  1.479 

The  first  is  an  extension  of  graphical  analysis  to  ridge  analysis  with 
more  than  two  independent  variables.  One  response  is  maximized  or  mini- 
mized while  constrained  by  an  upper  bound  on  the  second  response.  The 
variables  are  constrained  to  fall  on  the  sphere  of  radius  R by 

n 

^ x^  = R (2.22) 

i = 1 

and  ridge  analysis  is  iteratively  performed,  starting  with  the  indepen- 
dent variable  values  which  optimize  the  objective  response,  until  the 
constraint  responses  are  satisfied.  The  second  technique  is  a multiple 
objective  technique  where  the  multiple  responses  are  combined  into  one 
response  by  use  of  subjective  weightings.  Montgomery,  Talavage,  and 
Mullen  (46),  in  1971,  pursued  the  weighting  technique  in  the  multiple 
response  surface  optimization  of  a traffic  network  computer  simulation. 
Two  responses,  average  delay  per  vehicle  and  average  stop  p 'r  vehicle, 
were  linearly  combined  by  transforming  both  to  seconds  of  delay.  This 
composite  response  was  optimized  according  to  the  techniques  discussed 
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in  the  first  section  of  this  chapter. 

Nonlinear  programming  techniques  are  readily  adapted  for  use  in 
constrained  optimization  of  multiple  response  surfaces.  Carroll  (14), 
in  1960,  devised  the  Created  Response  Surface  Technique  which  incorpo- 
rates the  constraint  responses  into  the  objective  response  by  the  use  of 
a penalty  function.  As  the  steepest  ascent  optimization  approaches  the 
boundaries  of  the  constraints,  the  objective  function  is  penalized  at  a 
greater  rate.  Thus,  through  the  sequential  application  of  unconstrained 
optimization  techniques,  the  stationary  point  is  reached  without  violating 
the  constraints.  This  technique  was  a forerunner  of  barrier  and  penalty 
function  techniques  in  nonlinear  programming.  In  1960  Box  (11)  advocated 
the  use  of  linear  programming  for  the  solution  of  multiple  response 
chemical  problems. 

Lind,  et  al,  (41)  applied  the  graphical  analysis  technique  to 
optimize  the  system  shown  in  Figure  11.  The  two  responses  were  cost  and 
yield  of  a pharmaceutical  process  of  American  Cyanamid  Company.  A simi- 
lar optimization  of  cost  and  yield  was  performed  on  a liquor  fermentation 
process  by  Reramers  and  Dunn  (51).  Smith  and  Rose  (55),  in  1963,  utilize 
the  graphical  technique  with  an  interesting  modification.  One  response  is 
is  a usual  empirically  determined  equation  while  two  other  response  equa- 
tions are  from  subjective  ratings.  Graphical  analysis  was  also  utilized 
by  Wu  (68)  in  tool  life  testing,  Ellis,  et  al,  (22)  in  Raschig  synthesis 
of  Hydrazine,  and  Taraman  and  Lambert  (56)  in  selection  of  machining 
variables.  The  graphical  technique  can  and  has  served  as  both  a multiple 
objective  and  a constrained  optimization  technique. 

While  analyzing  the  design  of  extruder  screws,  Underwood  (58) 
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suggested  that  the  advent  of  computers  allowed  for  an  enumeratlve  search 
for  the  optimum  of  a multiple  response  system.  Bolker  (9)  utilized  this 
technique  in  studying  dellgnif ication  by  Nitrogen  compounds.  He  set  one 
response  at  consecutive  values  and  solved  the  response  functions  simulta- 
neously. 

As  nonlinear  programming  progressed,  so  did  its  application  to 
multiple  response  surface  optimization.  Bally,  et  al,  (3)  applied  non- 
linear optimization  to  the  kraft  pulping  process.  Responses  such  as 
yield,  brightness,  and  Kappa  number  were  optimized  by  an,  unfortunately, 
undisclosed  nonlinear  technique.  A method  termed  cheapest  ascent  was 
developed  by  Heller  and  Staats  (30),  in  1973.  They  combined  a yield  re- 
sponse and  a cost  constraint  response  into  a profit  objective  response. 
Since  the  value  of  the  gradient  is  dependent  upon  the  metric  used,  a 
common  scale  of  equal  costs  per  unit  change  was  adopted.  Constraints  on 
the  system  were  both  algebraic  and  response  surface  functions.  The  sys- 
tem was  optimized  utilizing  Zoutendijk's  method  of  feasible  directions. 

The  LaGrange  Multiplier  approach  was  modified  by  Myers  and  Carter 
(48),  in  1973.  They  did  not  equate  the  constraint  response  to  a specific 
value,  but  rather  devised  a methodology  which  allowed  a graphical  display 
of  optimal  primary  response  solutions  for  varying  values  of  the  constraint 
response.  Two  problems  were  solved  in  the  article.  The  first  consisted 
of  three  Independent  variables  with  region  constraints 

-2.5lx^<2.5  (i  - 1,2,3)  (2.23) 


forming  the  dual  responses 


Yp  = 65.39  + 9.24x^  + 6.36x^  + 5. 22x^-7.32x^-7. 76x2-13. llx^  (2.24) 

-13 . 68Xj^X2-18 . 92Xj^X2-14 . 68X2X2 

= 56.42  + 4.65x2  2-56x2  5. 25x2  + 5.62x2  + 4.22x2  (2.25) 

+ 8.74X2X2  + 2.32X2X2  + 3.78X2X2 


Figure  12  is  solved  for  given  a value  of  y^.  Values  of  the  indepen- 
dent variables  are  then  obtained  from  Figure  13.  With  y = 65.0,  y was 

s P 

maximized  at  X2  = 2.07,  X2  = -1.15,  and  X2  = -0.6,  yielding  a response  of 
approximately  74.0.  A second  problem  was  solved  incorporating  spherical 
region  constraints  necessitated  by  an  unbounded  primary  response  within 
the  constraint  response  region.  Figure  14  shows  the  response  surfaces 
of  the  equations 

Yp  = 53.69  + 7.26x2-10.33x2  + 7.22xJ  + 6.it3x^  + 11.36Xj^x^  (2.26) 

y^  = 82. 17-1. 01X2-8. 6IX2  + 1.40X2-8.76X2-7.20X2X2  (2.27) 


Two  constraints  are  Imposed, 


84<y  <88 
s 


(2.28) 


2 2 , 
X2  + X2f_l. 


(2.29) 


The  primary  response  was  maximized  at  67.0  while  y «=  87.8  and  x,  = 0.85 

S X 

and  X2  “ 0.6.  Since  this  method  is  graphical,  it  is  limited  to  two  re- 


sponse equations  without  undue  difficulty  of  Interpretation.  Also  the  B 
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Figure  13.  Conditions  of  Constrained  Maxima  on  Primary  Response  for 
Fixed  Values  of  y . From  Myers  and  Carter  (48) 
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matrix  of  both  responses,  shovm  in  Equation  2.11,  cannot  be  indefinite 
or  solution  is  impossible  by  this  method. 

Further  application  of  nonlinear  programming  was  accomplished  by 
Fields  (23),  in  1974.  He  utilized  the  Hooke  and  Jeeves  Pattern  Search 
Technique,  diagramed  in  Figure  15,  to  optimize  versions  of  the  Umland  and 
Smith  and  Myers  and  Carter  problems  discussed  previously  in  this  section. 
Fields  examined  three  fonnulatlons  of  the  response  systems: 

1.  A single  objective  function  with  other  response  functions 
treated  as  constraints  and  explicitly  set  to  a fixed  value. 

2.  A single  objective  function  with  implicit,  penalty  function 
type  consideration  of  the  other  response  functions  as  constraints. 

3.  A weighting  function  combination  of  all  response  functions 
into  a single  function. 

He  concluded  that  the  first  formulation  was  unsatisfactory  due  to  the 
inability  to  slightly  violate  the  constraints.  The  second  formulation 
was  an  improvement,  though  requiring  numerous  computer  iterations  from 
various  starting  points  with  varying  penalty  sizes.  Fields  found  the 
most  promise  in  the  weighting  scheme  as  an  aid  to  the  decision  maker. 

In  his  research,  however,  various  weights  were  applied  with  solutions  dis- 
played in  tabular  format.  Once  again  the  computer  runs  required  are  con- 
siderable and  the  assistance  of  an  expert  is  necessary.  His  results  are 
compared  to  the  original  authors'  results  in  Table  4. 

A recent  addition  to  the  literature  is  the  work  of  Biles  (8),  in 
1975,  which  utilizes  the  gradient  projection  technique  of  nonlinear  pro- 
gramming. A primary  response  is  optimized  while  secondary  responses  are 
constrained  within  specified  bounds.  The  technique  is  mainly  the  usual 
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Table  4.  Comparison  of  Fields'  and  Original  Results 


Variable 

Umland 
and  Smith 

Flelda 

Myers 
and  Carter 

Vi 

83.66 

83.4562 

94.87 

94.9992 

’^ll 

0.965 

0.96643 

^21 

1.088 

1.07373 

rp2 

86.73 

86.6441 

^32 

92.47 

92.4998 

^2 

1.005 

1.00562 

^22 

1.316 

1.31055 

!p3 

88.68 

88.6623 

^33 

89.995 

89.9997 

Xi3 

11.075 

1.08223 

^23 

1.479 

1.47497 

> > 

M 

73.9145 

73.66 

^31 

64.9997 

65.22 

^11 

2.1250 

2.07 

^21 

-1.25 

-1.15 

"31 

-0.6222 

-0.6 

rp2 

67.5716 

67.8 

^32 

87.8056 

88.19 

’^12 

0.60 

0.85 

^22 

-0.80 

-0.6 
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gradient  search  optimization  unless  the  gradient  direction  leads  out  of 
the  feasible  region  described  by  the  constraint  responses.  Should  this 
occur,  gradient  projection  is  used  to  bring  the  search  direction  back  in- 
to the  feasible  region. 

As  can  be  seen  from  this  literature  survey,  most  of  the  research 
in  multiple  response  surface  optimization  has  been  devoted  to  constrained 
optimization  techniques  utilizing  various  nonlinear  programming  algorithms. 
Such  approaches  require  selection  of  a primary  response  with  relegation 
of  other  responses  to  constraint  status.  The  application  of  these  ap- 
proaches to  more  than  three  responses  has  not  been  demonstrated.  The 
military  decision  maker  may  well  desire  to  array  the  importance  of  multi- 
ple responses  in  a more  controlled  manner.  Thus  this  research  is  devoted 
to  the  application  of  a multiple  objective  optimization  technique  to  the 
multiple  response  problem. 

Multiple  Objective  Optimization  Literature  Survey 

Charnes  and  Cooper  (15),  in  1961,  proposed  goal  programming  as  a 

solution  technique  for  multiple  linear  objectives  with  linear  constraints. 

If  X . x„,  ...,  X are  a set  of  subgoals  to  be  achieved  and  a,,  a ...,  a 
1 2 n 1 2 n 

are  technological  coefficients,  then  the  objective  function  is 

f(x  ,x  ,.,.,x  ) = ax  + ax  + ...  + a x (2.30) 

12  n ii  22  nn 

The  constraints  can  be  expressed  in  the  form 

aiXf  = b^  (i  = 1,2, ...,n)  (2.31) 

where  b^  is  the  1 th  goal  value.  Deviation  above  or  below  a goal  is  ac- 
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conmodated  by  the  slack  variables  or  y^  respectively.  The  goal  pro- 
gramming problem  is  then  expressed  as 

MinZ=/+2"  (2.32) 

S.T.  Ax  + - :L  = ^ 

x,d  .d"*^  ^ 0. 

Solution  by  usual  linear  programming  methods  will  yield  values  of  3c  which 
come  closest  to  meeting  the  goal  values,  _b.  Nonlinear  objectives  or  con- 
straints were  not  considered.  Ijiri  (37)  modified  the  technique  of 
Charnes  and  Cooper  to  develop  the  formulation  stated  in  Equation  2.32. 
Since  most  problems  would  not  have  completely  compatible  goals,  Ijiri 
proposed  a weighting  and  ordering  scheme  to  allow  the  decision  maker  to 
set  goal  priorities. 

In  1971,  Ruefli  (52)  extended  goal  programming  by  adapting  it  to 
linear  decomposition  models.  He  worked  with  goals  being  set  at  various 
levels  In  an  organization.  Lee  (39)  has  been  a prolific  advocate  of 
goal  programming.  He  recognizes  that  goal  programming  is  very  limited 
in  nonlinear  situations  and  cites  no  examples  in  his  text  written  in 
1972.  Lee  does  detail  applications  of  linear  goal  programming  ranging 
from  financial  decisions  to  academic  planning  to  government  decision 
analysis.  Lee  and  Moore  (AO),  in  1973,  apply  goal  programming  to  the 
linear  optimization  of  multiple  objective  transportation  problems.  In 
that  same  year  Hindelang  (32)  discussed  the  application  of  multiple  ob- 
jective linear  goal  programming  to  Quality  Control  optimization. 

Johnsen  (38),  in  1968,  reviews  the  basic  results  of  Charnes  and 
Cooper  and  Ijiri  prior  to  researching  the  application  of  computer  Simula- 
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1 

I 

tion  to  the  multiple  objective  problem.  He  proposes  that  simulations  be  j 

performed  on  a multiple  objective  system  with  varying  limits  on  the  ob-  j 

jectives.  This  technique  would  apply  only  to  situations  which  could  be 
simulated  in  total  and  would  require  considerable  computer  time. 

Wlien  confronted  wit'^  optimization  of  a refinery,  Seinfeld  and 
McBride  (54),  chose  two  formulations  of  the  multiple  objective  problem. 

Their  two  objectives  were  to  maximize  total  profit  and  to  minimize  the 
sensitivity  of  profit  to  variations  in  refinery  conditions.  The  first 
formulation  was  a weighted  combination  of  the  two  objectives.  The  second 
approach  was  to  maximize  the  primary  objective,  then  minimize  the  second 
objective  while  constraining  the  displacement  of  the  solution  from  the 
primary  optimum.  Zoutendijk's  method  of  feasible  direction  was  used  for 
the  nonlinear  optimization.  The  first  formulation  requires  an  initial 
subjective  weighting  by  the  decision  maker.  The  second  approach  implies 
a primary  objective  and  a secondary  objective  which  will  be  violated  by 
an  uncontrollable  amount. 

Another  approach  to  the  linear  multiple  objective  problem  is  POP, 

Progressive  Orientation  Procedure,  devised  by  Benayoun,  Tergny,  and 
Keuneman  (7),  in  1970.  This  is  a sequential  procedure  of  weighted  linear 
optimizations  integrated  interactively  with  the  decision  maker.  By 
answering  questions  concerning  the  current  optimum,  the  decision  maker 
Influences  the  location  of  the  next  optimization.  Their  algorithm,  STEM, 
is  confined  to  linear  problems.  Geoffrion  (27)  utilized  a similar 
philosophy  in  Vector  Maximal  Decomposition  Programming.  He  uses  an  im- 
plicit preference  function  to  combine  multiple  nonlinear  objectives.  The 
perference  function  is  determined  interactively  with  the  decision  maker. 
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This  approach  will  be  discussed  in  detail  later  in  this  section. 

Multicriterion  linear  programming  problems  were  examined  by  Belen- 
son  and  Kapur  (6),  in  1973.  They  developed  a two  person  zero-sum  game 
approach  which  interacted  with  the  decision  maker  to  determine  dispari- 
ties between  the  solution  and  his  preferences.  Monarchi,  Kisiel,  and 
Duckstein  (45)  developed  an  algorithm  termed  a sequential  multiobjective 
problem  solving  technique,  SEMOPS,  to  interactively  solve  multiple  ob- 
jective nonlinear  goal  programming  problems.  The  algorithm  involves  a 
surogate  objective  function 

Min  s = d^  (2.33) 

where  d^  reflects  whether  a goal  has  been  satisfied.  SEMOPS  presents  the 
decision  maker  with  alternatives  from  which  to  choose.  The  approach  is 
very  similar  to  the  algorithm  adopted  by  this  research.  Vemuri  (65),  in 
1974,  developed  an  algorithm  which  sought  a noninferior  solution  set 
rather  than  an  optimum  solution.  It  is  based  on  deriving  the  Pareto 
optimal  set,  that  is,  the  line  from  which  a deviation  will  improve  no  ob- 
jective function.  Currently  this  algorithm  is  limited  to  specific  for- 
mulations of  the  objective  functions  and  no  constraints. 

The  multiple  objective  optimization  algorithm  adopted  by  this  re- 
search is  the  Geof f rlon-Dyer  Interactive  Vector  Maximal  algorithm.  Chap- 
ter III  of  this  research  will  detail  the  algorithm,  thus  the  following 
will  be  a description  of  its  development.  The  early  theoretical  work  by 
Geoffrion  (27)  has  previously  been  discussed.  Geoffrion  and  Hogan  (29), 
in  1972,  formalized  an  algorithm  and  applied  it  to  two-level  organizations 
with  multiple  objectives.  An  overall  oojective  function  of  the  decision 
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maker's  utility  function  is  optimized  without  explicit  knowledge  of  the 
function.  Marginal  rate  of  substitution  Indifference  tradeoffs  between 
objectives,  interactively  developed  by  the  decision  maker,  are  transformed 
into  point  gradients  of  his  utility  function.  These  are  maximized,  sub- 
ject to  region  definition  constraints,  to  product  an  optimal  direction 
vector.  The  decision  maker  then  selects  an  optimal  solution  along  this 
vector.  Linearity  is  not  a requirement  in  objectives  or  constraints. 

Dyer  (21)  adapted  the  algorithm  to  Interactive  Goal  Programming. 

Nonlinear  functions  were  applicable  to  the  algorithm  but  Dyer  cautioned 
that  his  adaptation,  "...  can  be  expected  to  provide  an  optimal  solution 
to  the  multiple  criteria  problem  only  in  restrictive  special  cases."  He 
found  value  in  the  insights  and  alternatives  which  the  algorithm  presented 
to  the  decision  maker.  Garrido  (26),  in  1974,  altered  the  suboptimization 
portion  of  this  algorithm  by  utilizing  LaGrange  Multipliers  in  an  applica- 

1 

tlon  to  Multi-Item  Inventory  systems.  I 

In  December  1972,  Geoffrion,  Dyer,  and  Feinberg  (28)  formalized 
the  basic  algorithm.  An  article  was  published  detailing  the  algorithm  and 
its  application  to  the  operation  of  an  academic  department.  Dyer  (19),  in 
1973,  published  an  article  describing  an  ALGOL  computer  program  of  the  i 

algorithm.  He  displayed  output.  Figure  16,  of  the  algoritlim  optimizing  j 

I 

an  automobile  purchase  decision.  In  a later  article  (20),  he  describes  an  ' 

I 

experiment  with  graduate  student  subjects  knowledgeable  in  mathematical 
programming,  solving  the  automobile  problem  with  various  algorithms.  The 
Vector  Maximal  algorithm  received  unanimous  subjective  praise  for  ease  of 
use  and  comprehension.  Most  recently,  Courtney  (17)  has  drafted  a paper 
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C 

Er.ter  Desired  Perturbations 

□ ^ \ 

-100  10  2 J 

Figure  16.  Sample  Output  From  the  VM  (Vector  Maximal)  Program. 
From  Dyer  (19) 


applying  the  algorithm  to  capital  appreciation  and  income  portfolio 
selection. 
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This  brief  survey  of  multiple  objective  optimization  has  revealed 
a majority  of  effort  on  the  linear  problem.  The  work  of  Geoffrion  and 
Dyer  stands  out  in  the  nonlinear  problem  area.  Utilization  of  the  Inter- 
active Vector  Maximal  algorithm  would  allow  participation  of  the  military 
decision  maker  in  the  optimization  process.  His  military  experience  and 
expertise  would  be  utilized  in  making  controlled  marginal  rate  of  sub- 
stitution decisions.  After  an  optimal  direction  is  determined,  the  mili- 
tary decision  maker  would  perforin  the  uni-directional  search  optimization. 
In  this  alliance  between  military  decision  maker  and  mathematical  program- 
ming, the  "black  box"  fixed  solution  syndrome  is  alleviated  if  not  elimi- 
nated. Since  all  alternatives  are  presented  to  the  decision  maker  in  the 
dependent  response  space  rather  than  the  independent  variable  space,  a 
multitude  of  alternate  solutions  are  considered.  An  application  of  the 
Geoffr Ion-Dyer  Interactive  Vector  Maximal  algorithm  to  multiple  response 
surface  optimization  would  seem  to  generate  favorable  dividends.  It  is 
in  that  direction  which  this  research  will  now  proceed. 


fli 
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CHAPTER  III 

DEVELOPMENT  OF  AN  OPTIMIZATION  METHODOLOGY 

The  Frank-Wolfe  Linear  Approximation  Alfiorlthm 
The  theoretical  basis  of  the  Geoff rion-Dyer  Interactive  Vector 
Maximal  algorithm  is  the  Frank-Wolfe  Linear  Approximation  algorithm. 
Development  of  a methodology  involving  the  latter  algorithm  must  there- 
fore begin  with  the  former.  The  Frank-Wolfe  algorithm  (69)  solves  the 
nonlinear  programming  problem 

Max  f (}c) 

S.  T.  Ax  £ b (3.1) 

x>0 

by  means  of  linear  approximations.  The  linear  approximation  to  f (£) , 
where  £ is  a solution  to  Equation  3.1,  at  the  feasible  point  x'^  is  f (£) 
where 

fj^(£)  = f(x‘')  + Vf  (x‘')’'(£-x‘').  (3.2) 

The  algoritfim  seeks  to  maximize  the  linear  approximation  of  the  objec- 
tive function  within  the  constraint  set.  By  substitution  of  Equation 
3.2,  Equation  3.1  becomes 

Max  f(x*')  + Vf(x’')''(£-xS  (3.3) 

S.  T.  A£  £ ^ 

£ £ 0 
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Futher  simplification  is  possible  by  realizing  that  x is  a fixed  feasi- 
ble point  throughout  an  iteration  of  the  algorithm,  rendering  several 
terms  in  the  objective  function  constant. 

The  final  form  of  Equation  3.3  is 


Max 

S.T.  ^ b 

2.  i ® 


(3.4) 


The  optimum  ^ of  Equation  3.4  is  constrained  to  be  feasible  and  is  the 

maximum  of  the  linear  approximation  of  the  original  objective  function. 

k k k 

An  improved  value  of  f should  lie  on  a direction  ^ from  x to  ^ : 


,k  k k 
d = X • 


(3.5) 


A uni-direction  search  is  therefore  conducted  along 

x*"  + t(x’'-x‘')  0 ^ t ^ 1 (3.6) 

k + 1 

to  yield  an  improved  and  feasible  2C  for  the  next  Iteration  of  the 

algor itlun.  The  algorithm  terminates  at  solution  point  ic*  if  the 
solution  to  Equation  3.4  where  2i  = 2i*»  implies 

Vf (x*)*^(j^*-x*)  1 0 . (3.7) 

By  substituting  Equation  3.5  into  3.7  it  is  seen  that  jc*  satisfies  the 
Kuhn-Tucker  conditions  that  are  necessary  for  optimality.  Farkas 'Lemma 
(69)  states  that 


A7 


for  all  X such  that  Ax  £ 0 is  equivalent  to  the  statement  that  there 
exists  u.  ^ 0 such  that 

q + a'^u  = 0.  (3.9) 

In  Equation  3. A, 


A^  ^ ^ ^ 0» 


(3.10) 


thus 


7(Ax-b)  < 0.  (3.11) 

Substituting  Equation  3.7  and  3.11  into  3.8  yields  this  version  of  3.9: 

Vf(x*)  + V (A^-^)u  = Q.  (3.12) 


which  are  the  Kuhn-Tucker  conditions  necessary  for  optimality. 

Zangwill  (69)  proves  the  following  Convergence  Theorem  for  a non- 
linear programming  problem: 

Let  the  point-to-set  map  A:V  -*•  Vj^determine  an  algorithm  that  given 
at  point  Z'cV  generates  the  sequence  {£  } ..  Also  let  a solution  set 
JJCV  be  given. 

Suppose 

(1)  All  points  ^ are  in  a compact  set  XCV. 

(2)  There  is  a continuous  function  Z:V  -*•  such  that: 

(a)  if  ^ is  not  a solution,  then  for  an  yEA(^) 


Z(2)  > Z(z) 

(b)  if  £ is  a solution,  then  either  the  algorithm  terminates 
or  for  any  ^gA(^) 


Z(^)  ^ Z(z) 


1 
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and 

(3)  The  map  A Is  closed  at  ^ if  £ Is  not  a solution. 

Then  either  the  algorithm  stops  at  a solution,  or  the  limit  of  any 
convergent  s-bsequence  is  a solution. 

The  foregoing  Frank-Wolfe  algorithm  will  now  be  shown  to  be  convergent 

(69).  An  assumption  must  be  made  that  f is  continuous  and  differentiable 

and  that  the  feasible  region  is  compact.  Compactness  is  equivalent  to 

assuming  that  the  feasible  region  is  closed  and  bounded.  By  this  second 

k k 

assumption  part  (1)  of  the  Theorem  is  proved  since  x is  feasible,  ^ is 
feasible,  and  any  point  on  a straight  line  between  them  is  feasible. 

To  prove  part  (2a),  assume  that  x'  is  not  a solution.  Then  J.et 
be  the  solution  to  Equation  3.4  with  x = x' . Since  x'  is  not  a solution 
Equation  3.7  becomes 

Vf  (x')*^(x'-x')  > 0.  (3.13) 

But  Equation  3.13  states  that  is  an  improving  direction  for  f.  Let  w 
be  a point  on  within  Equation  3.6.  Then 


f(w)  > f(x') 


(3.14) 


Part  (2b)  clearly  holds  if  ^ = 2i  and  Z(^)  = f (jc ) . 

The  final  step  in  establishing  convergence  of  the  algorithm  is 
proof  of  part  (3)  of  the  Theorem.  Let 


k « 

X X 


(3.15) 


and 


,k  0 
d -+  d 


(3.16) 
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Substitution  of  Equations  3.15  and  3.16  into  3.5  yields 

^ 00  00  00 


(3.17) 


The  algorithmic  map  is  separated  into  two  maps,  D which  determines  the 

k + 1 

Improving  direction,  and  M which  calculates  jt  given  the  improving 

direction: 


A = MD  (3.18) 

The  map  M was  shown  to  be  closed  in  the  proof  of  part  (1).  To  prove  D 

00 

is  closed,  it  is  sufficient  to  show  that  ^ solves  Equation  3.4  where 

00  00  00  oo 

jc  " 21  • Then  since  jd  = ^ > 

00  00  00 
(2^  , d ) cDix). 

Since  ^ is  one  it  is  feasible.  By  definition  of  ^ 

> Vf  (2c‘')'^(i-2c‘")  (3.19) 

for  any  feasible  Taking  the  limit  of  Equation  3.19  as  k -+•  “>  yields 

00  f 00  00  00  f 00 

Vf(2i  -X  ) > Vf(2t  ) (x-2i  ),  (3.20) 

00  00 

which  states  that  x solves  Equation  3.4  for  21  “ 21  since  Equation  3.20 
is  true  for  all  feasible  x-  The  map  D is  thus  closed.  Zangwlll  (69)  has 
proven  a theorem  which  states  that  if  maps  M and  D are  closed  in  Equation 
3.18,  map  A is  closed.  This  completes  the  proof  of  convergence.  Wolfe 
(67)  has  done  further  work  to  establish  upper  and  lower  bounds  on  the 
rate  of  convergence  of  the  Frank-Wolfe  algorithm. 
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The  Geoff rion-Dyer  Interactive  Vector  Maximal  Algorithm 
The  development  and  theoretical  basis  of  the  Interactive  Vector 
Maximal  algorithm  have  now  been  discussed.  The  following  will  be  a 
detailed  description  of  the  algorithm  (1,19,20,28,29).  The  multiple 
objective  optimization  problem  can  be  stated  as 

Max  U [f^(x),f2(x) fj.(x)  ] (3.21) 

S.  T.  xeX 


where  f.,  i = 1,2 r,  are  distinct  objective  functions,  X is  the  fea- 

sible decision  variable  space,  and  U is  the  decision  maker's  utility 
function  defined  on  the  range  of  f.  The  utility  function  U and  each  f^ 
is  assumed  to  be  concave  and  continuously  differentiable,  and  U is  increas- 
ing in  each  f^.  If  some  f^  are  convex,  that  is,  utility  decreases  for 
an  Increase  in  f^,  then  a change  of  sign  for  that  f^  will  be  required. 

The  space  X is  assumed  to  be  convex  and  compact. 

Equation  3.21  can  be  solved  by  the  Frank-Wolfe  algorithm  as  fol- 
lows : 

Step  0.  Choose  an  initial  feasible  solution  x cX.  Let  k = 1. 

Step  1.  Determine  an  optimal  solution  ^ of  the  direction  finding 

problem. 

Max  V^U  [f^(x‘').f2(x'') f^(x‘')  ] -y  (3.22) 

S.  T. 


Let  d*^ 


k k 
1 -21  • 


Step  2. 


Determine  an  optimal  solution  t of  the  step-size  prob- 


lem 
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Max  U + td*"),  + td'"),...,f^(x*'  + td*")  ] (3.23) 

0 < t < 1 . 


if  the  solution  is  optimal,  terminate.  Otherwise  let 


k +1  k ^ ,k 

2L  = 2i  + t^  , 

k = k + 1, 


(3.24) 


and  return  to  Step  1. 

The  Frank-Wolfe  algorithm  was  chosen  for  its  computational  simplicity, 
its  well  established  convergence  discussed  earlier,  and  its  rapid  initial 
rate  of  convergence  as  discussed  by  Amor  (2,19). 

An  immediate  difficulty  in  this  procedure  is  the  necessity  of 
quantifying  the  gradient  of  the  decision  maker's  utility  function  in 


Equation  3.22,  By  application  of  the  chain  rule. 


7^0  |■f^(x‘'),f2(x‘'),....f^(x'') 


r 

N 

i = 1 


»■”> 


where 

( 


/—  1 
V^il 


is  the  1 th  partial  derivative  of  LI  evaluated  at  the  point 


[k  Ic  k T k 

f (x  ),f2(x  ),...,  f^(2t  ) , and  V^f^(5c  ) is  the  gradient  of  f^  evaluated 

at  Jc  . By  substitution  of  Equation  3.25,  3.22  becomes 


Max 


(»:) 


(3.26) 


S.  T.  2 e X 


Except  for  the  partial  derivatives  of  U,  the  quantities  in  Equation  3.26 
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are  known.  The  solution  of  Equation  3.26  is  not  affected  by  multiplica- 
tion of  the  objective  function  by  a scalar.  Thus  the  objective  function 

/ gu  \ k 

can  be  multiplied  by  the  positive  reciprocal  of  a | r-j—  ) . As  a stan- 

dard  convention,  I -tt—  I is  utilized.  The  original  vector 

Vhj 


(3.27) 


is  colinear  with  the  new  vector 


(1,  / aU/Bf^  \ k I 3U/3f^  k^ 

\ 3U/3f^  ’ ’ \3U/3fj^  / j 


(3.28) 


The  components  of  Equation  3.28  are  termed  the  marginal  rates  of 
substitution  between  f^  and  = 2,3,...,r,  that  is  the  preferred  trade- 

offs between  objective  1 and  objective  i.  There  are  several  methods 
available  to  obtain  the  tradeoffs.  The  method  utilized  in  this  research 
is  the  ordinal  comparison  method,  that  is,  "I  prefer  A to  B."  This 
method  has  been  shown  to  be  superior  to  the  other  methods  (20).  Initial 
perturbations  of  Af^,  i = l,2,...,r,  are  obtained  from  the  decision 
maker.  These  perturbations  are  obtained  in  a direction  favorable  to  the 
decision  maker,  thus  satisfying  the  need  of  sign  determination  for  f^ 
discussed  earlier  in  the  initial  assumptions.  The  first  perturbation, 

Afj^  is  the  reference  perturbation. 

The  decision  maker  is  presented  with  two  vectors,  A being  fj^(2i  ). 

1 = l,2,...,r,  and  B being  (fj  + fj_^,  f , . . . , f^)  . 

If  the.  decision  maker  prefers  B,  Figure  17(a),  Af^  is  doubled.  This  is 

y 

repeated  until  A is  preferred.  If  A is  preferred,  Af^  is  halved.  This 
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is  repeated  until  B is  preferred.  After  possibly  several  iterations  of 

this  procedure,  the  decision  maker  is  indifferent  to  the  ordinal  com- 

k* 

parison  presented  and  Af^  is  determined,  Figure  17(b).  This  procedure 

k* 

is  repeated  until  all  Af^  , 1 = 2,3,...,r,  are  determined. 

One  alternate  method  of  determining  the  tradefoof  is  to  simply  ask 
the  decision  maker  what  change  in  the  first  objective  value  would  exactly 
compensate  a given  change  in  each  of  the  other  objective  values.  Another 
method  would  be  to  place  the  objective  function  values  1 and  i on  axes  of 
a graph  and  designate  the  current  solution  point.  A reference  point  is 
then  chosen  and  the  decision  maker  trades  off  movement  on  one  axis 
against  the  other.  Probably  the  least  desirable  method  would  be  to  ob- 
tain a range  of  tradeoff  values  from  the  decision  maker,  and  solve  the 
direction  finding  problem  with  all  values  given.  The  decision  maker  would 
then  choose  a solution  from  the  several  generated  step-size  problems.  It 
has  been  shown  that  the  algorithm  will  converge  even  though  errors  are 
made  in  the  determination  of  the  tradeoffs  as  long  as  the  errors  decrease 
with  each  iteration  (28).  This  is  not  unreasonable  to  assume  since  each 
iteration  will  educate  the  decision  maker  in  the  implications  of  his 
tradeoffs. 

After  the  tradeoffs  are  determined,  the  approximation  is  made 


3U/3  f^ 

3U/a  fj 


Af 


Af 


1,2,. 


(3.29) 


By  substitution  of  Equation  3.29,  3.36  becomes 


f 


^ k^  „ f.(x*').y 
Max  w Vjc  1 — 

S.  T.  X e X 


(3.30) 


of  which  all  quantities  except  ^ are  known.  Equation  3.22,  and  therefore 
Step  1 of  the  Frank-Wolfe  method,  can  now  be  solved.  Step  2 is  solved 
by  presenting  the  decision  maker  with  alternatives 


f + td*^)  0 < t < 1 


(3.31) 


By  choosing  his  preferred  alternative  from  Equation  3.31,  the  decision 
maker  solves  3.23.  He  is  then  allowed  to  return  to  Step  1 or  terminate 
the  algoritlim. 

The  Interactive  Vector  Maximal  Algorithm  is  now  seen  to  be: 

Step  0.  The  decision  maker  chooses  an  initial  point  sc^eX.  Let 

k = 1. 

Step  1(a).  The  decision  maker  assesses  his  tradeoff  weights  w . 


(b) . Compute  the  optimal  solution  ^ of  Equation  3.30. 


T k k 

Let  £ “ Z “2i  • 

Step  2.  The  decision  maker  chooses  an  optimal  t to  Equation  3.31. 
If  the  decision  maker  is  satisfied,  terminate.  Otherwise  proceed  as  in 
Equation  3.24. 

It  is  important  to  realize  that  the  decision  maker  views  the  entire  prob- 
lem in  objective  value  space  rather  than  in  the  more  confusing  decision 
variable  space.  He  is  making  tradeoffs  of  objectives  with  no  distractions 
from  the  decision  variables.  He  is  also  seeing  a multitude  of  alternate 
solutions  as  lie  progresses  through  the  procedure.  This  is  an  educational 


process  for  the  decision  maker  in  the  implications  of  his  tradeoffs  a- 
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mong  objectives.  There  is  no  requirement  for  the  decision  maker  to  be 
familiar  with  mathematical  programming.  It  was  showr  earlier  that  the 
algorithm  converges  to  an  optimal  solution.  The  decision  maker  may  sub- 
jectively terminate  the  algorltlim  once  he  feels  further  iterations  would 
yield  minimal  improvement. 

Adaptation  of  the  Interactive  Vector  Maximal  Algorithm  to  the 
Optimization  of  Multiple  Response  Surfaces 

Adaptation  of  the  Interactive  Vector  Maximal  Algorithm  to  the 
optimization  of  multiple  response  surfaces  must  begin  with  an  examination 
of  the  algorithm's  assumptions.  Utility  theory  shows  that  the  majority  of 
utility  functions  are  concave  and  continuously  differentiable.  Most 
multiple  response  problems  constrain  the  independent  design  variables  in 
one  of  three  ways.  First  the  variables  may  be  given  range  constraints 
such  as 


1 X.  b.  i = l,2,...,k  . (3.32) 

These  constraints  are  of  course  straight  line  segments  and  describe  a 
convex,  compact  set.  A second  alternative  would  be 


X . + X.  < b _ 

1 3 - ij 


i.j 


1.2... .,k 


(3.33) 


These  are  also  straight  line  segments  and  satisfy  the  assumption, 
third  constraint  definition  would  be 


r 


1-1 


The 


(3.34) 


These  constraints  describe  a sphere  which  is  convex  and  compact. 
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The  assumption  which  is  violated  concerns  the  concavity  or  convex- 
ity of  f^,  the  response  functions.  As  discussed  in  Chapter  II,  and  pic- 
tured in  Figures  6 and  7,  a second  order  response  function  can  take 
various  shapes.  For  ease  of  interpretation,  the  two  variable  case  will 
be  discussed  though  the  discussion  applies  to  surfaces  of  more  than  two 
variables.  If  the  response  surface  is  a pure  maximum  or  minimum,  the 
assumptions  are  satisfied.  If  the  surface  is  a saddle  system,  local  and/ 
or  alternate  optima  might  exist.  In  this  case  the  algorithm  is  performed 
by  choosing  alternate  starting  points,  3^^,  and  proceeding  to  an  optimum 
point  in  each  case.  A thorough  procedure  would  be  to  start  from  each  ver- 
tex of  the  constraint  space  and  from  the  origin.  F.xperience  with  the 
surface  may  dictate  fewer  starting  points.  The  surface  optimum  would  be 
tlie  optimum  of  the  local  optima. 

The  existence  of  a ridge  system  also  requires  alteration  of  the 
algorithm.  As  long  as  the  decision  maker's  usual  tradeoffs  lead  to 
improvement,  the  algoritiim  proceeds  normally.  If  the  current  sc  lies  on 
the  down  slope  of  the  ridge,  normal  tradeoffs  will  lead  to  unsatisfactory 
alternatives  in  the  step-size  problem.  At  this  point  the  decision  maker 
should  reverse  the  sign  of  his  Af^^  perturbation  and  the  algorithm  will 
bring  him  back  up  the  ridge  to  an  improved  point.  If  the  current  21  lies 
on  the  crest  of  the  ridge,  neither  sign  of  u.sual  perturbations  will  lead 
to  Improvement.  At  this  time  the  decision  maker  must  judiciously  adjust 
the  sign  and  magnitude  of  his  perturbations  until  a different  search 
direction  is  generated.  This  is  not  difficult  if  the  Interactive  program 
displays  the  coefficients  of  Equation  3.30.  The  program  developed  for 
this  research  displays  these  coefficients  and  offers  another  method  of 


58 


solving  this  problem.  In  the  nonlinear  constraint  version  of  the  program, 
the  decision  maker  obtains  these  coefficients  from  the  main  program, 
terminates  the  main  program  and  optimizes  the  suboptimization  problem 
with  anotlier  program,  then  returns  to  the  main  program.  Upon  returning 
to  the  main  program,  he  could  input  a new  search  direction  to  move  the 
current  jc  off  the  crest  of  the  ridge.  The  presence  of  a semi-trained 
analyst  might  be  required  but  the  procedure  is  not  difficult.  Once  an 
Jt*'  not  on  the  crest  is  reached,  usual  perturbation  may  again  be  utilized. 
Application  of  the  algorithm  to  representative  problems  has  shown  the 
occurance  of  a current  2i  on  the  crest  of  a ridge  to  be  extremely  rare. 

The  three  design  variable  constraint  definitions.  Equation  3.32, 
3.33,  and  3.34,  yield  three  formulations  of  Equation  3.30.  The  w^  and 
V f . (x  ) are  known  and  are  constants.  Thus  Equation  3.30  and  3.32  reduce 

24  1 ~ 
to 


Max  7 c .y 
^ 11 

i = 1 


S.  T.  a^  y^  b^  i = 1,2, . . . ,r 


(3.35) 


where  c^  = 
tion.  If 
negative , 
tion  3.33 


w )•  Equation  3.35  can  be  solved  by  direct  substltu- 

c^  is  positive,  then  set  y^  at  its  upper  bound,  b^.  If  c^  is 
set  y^  at  its  lower  bound,  a^.  Constraints  of  the  type  Equa- 
yleld 


r 


Max 


"i^i 


(3.36) 


S.  T.  Ax  < b 
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This  is  the  classic  linear  programming  problem  and  can  be  solved  by  the 
simplex  method.  Constraints  such  as  Equation  3.34  yield 

r 

Max  2] 

1=1  (3.37) 

S.  T.  X = b . 

i = 1 

This  research  used  the  Bazaraa  Cyclic  Coordinate  Algorithm  for  Optimizing 
Penalty  Functions  computer  program  (5)  to  solve  Equation  3.37. 

The  interactive  optimization  algorithm  was  programmed  in  FORTRAN 
for  use  on  a CDC  computer  through  two  programs,  listed  in  Appendix  D. 

The  first  program  is  utilized  for  data  input.  As  can  be  seen  from  an 
example  run  in  Figure  18,  the  decision  maker  responds  to  interactive 
questions  The  only  analysis  required  is  to  compute  gradients  of  the 
response  functions.  The  upper  and  lower  bounds  of  x^  are  defining  the 
region  of  experimentation  utilized  for  the  second  order  model  and  thus 
must  coincide  for  all  response  functions.  An  example  of  the  interactive 
optimization  program  is  shown  in  Figure  19.  The  coefficients  mentioned 
as  aids  in  ridge  problems  are  seen  between  the  tradeoffs  and  the  new 
decision  vector. 

Application  of  the  MethodoloRv  to  Multiple  Response  Surface  Problems 
This  section  will  examine  the  application  of  the  adapted  Inter- 
active Vector  Maximal  algorithm  to  the  multiple  response  surface  problems 
utilized  by  Fields.  These  problems  were  previously  solved  by  Myers  and 
Carter  and  Umland  and  Smith  as  discussed  in  Chapter  II.  It  must  be  re- 
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1 NPl'T  Nl'MHEF  OE  PFSPONSE  EQUATIONS 
? 2 

INPUT  NUMhEP  OF  INDEPENDENT  V^APIAPLES  (X’'S) 

? 3 

INPUT  INITIAL  UALUE  OF  INDEPENDENT  VAPIAPLES  VI TH  . AND 
? 

INPUT  COEFFICIENTS  OF  RESPONSE  EQUATION  1 

? - 7.  23,  - 7.  7 ft,  - I 3.  1 1, 0.  , 0.  , - 1 3.  - 18.9  2,  0.  , 0.  , - I A.  68, 0 

? 0.  , 0.  , 0.  , 0.  , 9. 2A,  ft.  3ft,  S.  2?,  0.  , 0.  , 65.  30 
INPUT  COEFFICIENTS  OF  RESPONSE  EQUATION  2 
? 5.25,5.  62,A.22,0.,0.,8.7A,2.23,0.,0.,  3.  78,0.,0.,0.,0. 

? 0.  , A.  65,  8. 39,  2.  5ft,  0.  , 0.  , 5ft.  92 

INPUT  RESPONSE  equation  NAMES  IN  GROUTS  OF  TEN  LETTERS 
AND  SPACES,  RIGHT  .JUSTIFIED,  ONE  PEP  LINE 
? MAX 

■>  MIN 

INPUT  COEFFICIENTS  OF  GRADIENT  E IX  I 
? -lA.Aft,  -13.ft8,-18.92,0.,C.,9.2A 
INPUT  COEFFICIENTS  OF  GRADIENT  F IX  2 
? - 1 3.  68,  - 1 5.  52,  - I A.  68,  0.  , 0.  , 6.  3 6 

INPUT  COEFFICIENTS  OF  GRADIENT  F IX  3 
? - 18.9  2,  - 1 A.  68,  -2ft.  22,  0.  , 0.  , 5.  22 

INPUT  COEFFICIENTS  OF  (, RADI  ENT  F IX  A 

? o.,o.,o.,o.,c.,o. 

INPUT  COEFFICIENTS  OF  GRADIENT  F IX  5 
? 0.,0.,0.,0.,0.,0. 

INPUT  COEFFICIENTS  OF  GRADIENT  F 2X  1 

7 10.5,8.  /A,2.32,0.,0.,A.ft5 

INPUT  COEFFICIENTS  OF  GRADIENT  F 2X  2 

? 8. 7A,  1 1 . 2A, 3.  78, 0.  , 0. , 8 . 39 

INPUT  COEFFICIENTS  OF  GRADIENT  F 2X  3 

7 2.32,3.  78 ,8.  AA,  0.  , 0.  , 2.  5ft 

INPUT  COEFFICIENTS  OF  GFADI  F'NT  F 2X  A 

7 0.,0.,0.,0.,0.,0. 

INPUT  coefficients  of  gradient  E 2X  5 

? C.,0.,0.,0.,0.,0. 

INPJJT  REGION  OF  INTEREST  BOUNDARY  DEFINITION,  1 FOP 
INTEGER,  L FOP  LINEAR,  OR  N FOR  NONLINEAR 
? I 

I NPUT  LOVTR  AND  UPPER  F^OUNCS  OF  XI 
7 -2. 5, 2. 5 

INPUT  LOVER  AND  UPPER  HOUNDS  OF  X2 
7 -2. 5, 2. 5 

INPUT  LOVER  AND  UPPER  HOUNDS  OF  X3 
? -2. 5, 2. 5 

.21A  CF  SECONDS  EXECUTION  TIME 


Figure  18 


Example  of  Data  Input  Computer  Program 
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Figure  19.  Example  of  Interactive  Optimization  Computer  Program. 
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membered  that  the  original  and  Fields'  solutions  were  obtained  from 
algorithms  designed  for,  and  limited  by,  a primary  and  one  constraint 
response  function.  Their  solutions  are  supposedly  precise  mathematical 
programming  solutions.  In  solving  these  problems  with  the  methodology 
of  this  research,  close  approximation  to  the  previous  solutions  will  be 
considered  validation  of  the  methodology.  More  precise  approximations 
could  have  been  obtained  with  numerous  iterations  of  the  methodology 
and  extremely  large  numbers  of  step-size  alternatives  to  more  accurately 
approach  the  constraint  values.  Such  a procedure  would  have  approached 
the  numerous  iterations  of  Fields.  The  solutions  obtained  in  this  re- 
search are  meant  to  approximate  the  effort  which  would  be  expended  by  a 
decision  maker.  It  will  be  seen  that  even  without  extensive  computer  time 
or  iterations,  the  methodology  of  this  research  compares  favorably  with 
the  other  solution  techniques. 

Tlie  first  problem  is  the  Uraland  and  Smitli  problem  shown  in  Figure 

10  and  with  response  functions  represented  by  Equations  2.20  and  2.21. 

A canonical  analysis  of  Equation  2.20  indicated  a stationary  point,  x = 

~o 

(2.25,2.35)  and  eigenvalues  = -7.38  and  = -2.61.  This  surface  is 
a maximum.  Equation  2.21  has  a stationary  point  3^  = (1.15,  0.11)  and 
eigenvalues  X^  = -10.99  and  X^  = -3.39.  This  surface  is  also  a maximum. 
The  initial  point  was  chosen  to  be  x^  of  the  primary  response.  Figures 
20,  21,  and  22  graph  the  movement  of  the  algorithm  while  Table  5 compares 
results. 

The  next  problem  is  the  first  Myers  and  Carter  problem  given  by 
Equations  2.2A  and  2.25.  A canonical  analysis  of  Equation  2.24  yielded 
3^  = (-8.08,  3.89,  3.85),  which  is  outside  the  constraint  region,  and 


Figure  22.  Algorithm  Movement  on  Umland  and  Smith  Problem,  v <95.0 

s — 


Table  5. 

Comparison  of  Umland 

and  Smith  Problem 

Solutions 

Variable 

Umland 

F ields 

This 

and  Smith 

Research 

^Pl 

88.68 

88.66 

88.11 

^sl 

89.995 

89.9997 

90.003 

’^ll 

1.075 

1.082 

1.285 

^12 

1.479 

1.475 

1.343 

^P2 

86. 

.73 

86.64 

86.29 

ys2 

92, 

.47 

92.4998 

92.47 

X.  „ 

1, 

.005 

1.0056 

1.174 
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eigenvalues  = -25.65,  X^  = -2.63,  and  X^  = 0.18.  This  surface  is  a 
slight  saddle  system  with  an  optimum  outside  the  region  of  experimenta- 
tion. One  must  beware  of  local  optima  during  the  optimization  procedure. 
Canonical  analysis  of  Equation  2.25  showed  jc^  = (.52,-1.18,  .08)  and 
eigenvalues  X^^  = 10.55,  ~ 3*56,  and  X^  = 0.98,  which  indicates  a 

minimum  surface.  The  algorithm  was  initialized  at  various  starting 
points.  Table  6 details  the  results  of  these  searches  and  Table  7 com- 
pares the  optimum  solution  with  previous  results.  The  local  optima 
found  in  this  researcli  were  also  found  in  Fields'  investigation.  This 
surface  also  required  the  use  of  ridge  system  procedures  during  its  op- 
timization. 

The  final  problem  is  the  Myers  and  Carter  Problem  Two  described  by 
Equations  2.26,  2.27,  2.28,  and  2.29  and  graphed  in  Figure  14.  Canonical 
analysis  of  Equation  2.26  indicated  = (-3.72,  4.09)  and  eigenvalues 
X = 12.52  and  = 1.13.  As  seen  in  the  Figure,  this  system  is  a minimum 
with  the  stationary  point  outside  the  region  of  experimentation.  Equation 
2.27  has  an  = (-*44,  -.31)  and  eigenvalues  X^  = -9.91  and  X2  = 2.55 
which  Indicates  a saddle  system.  The  constraint  of  Equation  2.29,  how- 
ever, is  so  restrictive  that  virtually  all  of  the  saddle  effect  is  elim- 
inated within  the  feasible  region.  It  is  interesting  to  note  that  such 
a restrictive  and  arbitrary  constraint  was  necessitated  by  the  Myers  and 
Carter  and  Fields  techniques.  Utilizing  the  methodology  of  this  research, 
however,  a more  meaningful  constraint  such  as  cost  or  production  time 
could  have  been  Incorporated  into  the  problem  formulation. 

The  constraint  formulation  of  the  Myers  and  Carter  Problem  Two  re- 
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Table  6.  Algorithm  Search  Results,  Myers  and  Carter  Problem  One. 


Point 

^1 

^2 

^^3 

Starting 

.52 

-1.18 

.08 

Solution 

1.00 

- .06 

-.52 

70.93 

64.08 

Starting 

2.5 

-2.5 

-2.5 

Solution 

2.02 

-1.17 

-0.69 

73.51 

64.70 

Starting 

2.5 

2.5 

2.5 

Solution 

1.29 

-0.30 

-0.61 

72.09 

64.73 

Starting 

0. 

0. 

0. 

Solution 

1.59 

-0.63 

-0.64 

73.03 

64.58 

Table  7. 

Comparison  of 

Myers  and 

Carter 

Problem  One 

Solutions . 

Variable 

Myers 
and  Carter 

F ields 

This 

Research 

73.66 

73.91 

73.51 

65.22 

64.9997 

64.70 

’^l 

2.07 

2.13 

2.02 

’'2 

-1.15 

-1.25 

-1.17 

^3 

-0.6 

-0.62 

-0.69 

qulred  the  utilization  of  the  Cyclic  Coordinate  Penalty  Function  subopti- 
mization program.  The  procedure  was  initialized  at  of  y^.  Figures 
23,  24,  and  25  trace  the  iteration  solutions  of  the  optimization  algorithm. 
Ta'  .e  8 compares  the  results  of  this  research  with  earlier  results. 

In  the  previously  solved  problems  of  this  section,  a close  approx- 
imation to  past  results  was  obtained  by  the  methodology  developed  in  this 
research.  The  surfaces  optimized  were  representative  of  multiple  re- 
sponse surface  shapes.  Two  constraint  formulations  for  the  feasible  re- 
gion were  optimized  in  two  and  three  variable  problems.  Application  of 
the  adapted  Interactive  Vector  Maximal  algorithm  to  multiple  response 
surfaces  has  increased  the  potentiality  of  their  optimization.  The  re- 
striction of  a primary  response  and  one  or  two  constraint  responses  no 
longer  applies.  Theoretically  sound  optimization  may  now  be  performed 
on  large  scale  multiple  response  surfaces  of  various  feasible  region 
constraint  definitions.  In  the  next  chapter,  this  research  will  de- 
monstrate the  methodology  on  a training  problem  applicable  to  OTEA. 

Table  8.  Comparison  of  Myers  and  Carter  Problem  Two  Solutions. 


Variable 

Myers 
and  Carter 

F lelds 

This 

Research 

67.80 

67.57 

67.78 

^s 

88.19 

86.81 

87.996 

’'i 

.85 

.60 

.8502 

^2 

-.60 

-.80 

-.5971 

87.996 

.8502 

-.5971 
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72 


CHAPTER  IV 

APPLICATION  OF  MULTIPLE  RESPONSE  SURFACE 
OPTIMIZATION  TO  AN  OPERATIONAL  TEST  PROBLEM 

Introduction  to  the  Problem 

In  Chapter  I the  importance  and  effects  of  training  in  operation- 
al testing  was  discussed.  The  utilization  of  computer  simulation  con- 
current with  an  OT  was  also  discussed.  In  Chapter  III  a methodology  was 
developed  to  analyze  and  optimize  multiple  response  surfaces.  The  role 
of  the  decision  maker  in  the  interactive  algorithm  and  the  benefits  ac- 
crued by  his  participation  were  discussed.  In  this  cliapter,  computer 
simulatic)!!  and  the  methodology  of  this  research  will  be  applied  to  a hy- 
pothetical acquisition  program. 

Subsequent  to  the  cancellation  of  the  costly  Main  Battle  Tank 
1970  (MBT70)  acquisition  program,  the  Army  began  development  of  the  less 
costly  MBT7&.  As  one  means  of  cost  reduction,  all  factors  of  system  ef- 
fectiveness were  considered  rather  than  exclusive  consideration  of  the 
MBT76  technological  capabilities.  The  Project  Manager  (PM)  felt  that 
crew  training  could  be  of  utmost  Importance  in  overall  MBT76  combat  ef- 
fectiveness. Prior  to  OT  II,  he  directed  an  analysis  of  the  effects  of 
crew  training  utilizing  a computer  simulation  of  a combat  situation  in- 
dicative of  the  European  environment.  The  laser  ranging  and  optical 
tracking  of  the  MBT76  were  sophisticated  enough  to  negate  any  effect 
of  training  on  weapon  accuracy.  Consequently  the  PM  directed  that  mean 
time  to  fire  the  first  round,  mean  time  between  rounds,  and  probability 
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of  sensing  be  studied  as  system  factors  affected  by  crew  training.  In 
this  initial  stage,  he  also  directed  that  one  scenario,  an  engagement 
between  two  tanks  in  the  open  at  a range  of  1000  meters,  be  analyzed  to 
establish  feasibility  of  the  methodology.  This  scenario  was  representa- 
tive of  tank  combat  in  the  European  theater. 

Utilization  of  the  AMSAA  Tank  Duel  Simulation 

The  MBT76  Analysis  Team  (AT)  used  the  AMSAA  Tank  Duel  simulation 
programmed  by  Mr.  Robert  Lake.  It  is  a low  level,  small  scale,  two- 
sided,  deterministic  model  used  to  simulate  brief  fire  engagements  be- 
tween two  armored  vehicles.  The  model  plays  a defending  vehicle  (MBT76, 
Blue)  which  is  stationary  and  fires  first  at  an  attacker  (Red)  which  is 
fully  exposed.  The  engagement  ends  when  a kill  occurs  or  when  a time 
limit  expires.  It  is  programmed  in  FORTRAN  IV  for  the  BRLESC  computer. 
Inputs  include  various  probabilities  of  hit  and  kill,  expected  time  to 
fire  rounds,  and  probabilities  of  sensing.  Outputs  include  the  probabi- 
lity of  victory  and  expected  number  of  rounds  fired. 

The  AMSAA  Tank  Duel  Model  was  well  suited  to  the  AT's  needs  with 
a few  modifications.  Planning  to  use  statistical  analysis,  the  AT  re- 
quired a stochastic  simulation.  Where  the  model  utilized  the  mean  of 
certain  probaliility  distributions,  the  AT  decided  to  input  random  devi- 
ates from  the  iistributions.  It  was  assumed  that  the  random  variables 
in  this  model  we.'e  normally  distributed.  The  means  and  variances  of  the 
various  inputs,  shown  in  Table  9,  were  based  on  OT  1 and  DT  I results 
for  the  MBT76  and  best  Intelligence  estimates  for  the  Red.  After  con- 
verting the  model  for  use  on  the  GDC  CYBER  74  computer,  as  shown  in 
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Appendix  B,  the  AT  wrote  two  programs  to  generate  the  random  deviates. 

The  first  program,  listed  in  Appendix  A,  utilized  a CDC  internal 
random  number  generator  to  generate  200  Uniform  (0,1)  random  deviates. 
The  generator  was  analyzed  by  a Chi-square  test  which  showed  that  at 
a = .11  the  random  deviates  were  U(0,1).  Table  10  shows  the  distribu- 
tion of  the  deviates.  The  Chi-square  statistic  was  computed  as  follows 


(33) 


X 


2 

0 


i = 1 


(4.1) 


2 

to  be  Xq  ~ 11.0.  The  U(0,1)  deviates  were  then  converted  to  N(0,1)  de- 
viates and  subsequently  to  normal  random  deviates  of  the  distributions 
in  Table  9.  This  conversion  was  accomplished  by  the  well  known  and 
tested  Fisliman  Equations  (24), 


1/2 

= (-2  logU^)  ' cos2'nU2 

= (-2  logU^)^^^sin27rU2. 


(4.2) 


where  X^  are  N(0,1)  and  are  U(0,1).  This  conversion  was  acCLmplished 

by  a computer  program  listed  in  Appendix  A.  A Chi-square  statistic  of 
2 

Xq  = 5.28  was  computed  for  the  N(0,1)  deviates  as  shown  in  Table  11.  At 
a = .27  the  deviates  are  distributed  N(0,1). 

Specification  of  the  scenario  by  the  PM  allowed  certain  model 
paramete.'s  to  be  fixed  for  all  trials  of  the  model.  These  values  are 
shown  in  Table  12.  The  time  of  flight  was  based  on  use  of  high  Explo- 
sive Anti-Tank  (HEAT)  rounds  with  a muzzle  velocity  of  3800  feet  per 
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Table  9.  Input  Variable  Normal  Distributions 


BLUE 


RED 


Input  Variable 


Mean 


Variance 


Mean 


Variance 


P(Hit 

1st  Rd) 

.75 

.0025 

.60 

.0025 

P (Rehit) 

.85 

.0011 

.75 

.0011 

P(Hlt 

Sensing  1st  Rd  Miss) 

.80 

.0011 

.7 

.0011 

P(Hit 

Loss  of  1st  Rd  Miss) 

.775 

.0017 

.625 

.0017 

P(Kill' 

1st  Rd  Hit) 

.5 

.0011 

.45 

.0011 

P(Kill 

Rehit) 

.85 

.0003 

.8 

.0003 

P(Kill 

Hit  n Sensing  1st  Rd  Miss) 

.5 

.0011 

.45 

.0011 

P(Kill 

Hit  n Loss  of  1st  Rd  Miss) 

.5 

.0011 

.45 

.0011 

P (Sensing) 

.525 

.0006 

Time  to  Fire  1st  Rd  (sec) 

8.5 

.6944 

Time  to  Fire  Subsequent  Rd  (sec) 

10.5 

.6944 

Table  10.  Distribution  of  11(0,1)  Deviates. 


Interval  Observed  Expected 


.00 

- 

.05 

7 

10 

.05 

- 

.10 

9 

10 

.10 

- 

.15 

10 

10 

.15 

- 

.20 

7 

10 

.20 

- 

.25 

9 

10 

.25 

- 

.30 

12 

10 

.30 

- 

.35 

9 

10 

.35 

- 

.40 

11 

10 

.40 

- 

.45 

6 

10 

.45 

- 

.50 

11 

10 

.50 

- 

.55 

15 

10 

.55 

- 

.60 

11 

10 

.60 

- 

.65 

11 

10 

.65 

- 

.70 

8 

10 

.70 

- 

.75 

9 

10 

.75 

- 

.80 

8 

10 

.80 

- 

.85 

11 

10 

.85 

- 

.90 

15 

10 

.90 

- 

.95 

12 

10 

.95 

-1 

.00 

9 

10 
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Table  11.  Distribution  of  N(0,1)  Deviates. 


Interval 

Observed 

Expected 

- - 2.0 

2 

13.36 

-2.0,  - 1.5 

10 

-1.5,  - 1.0 

17 

18.38 

-1.0,  - 0.5 

33 

29.96 

-0.5,  0.0 

47 

38.3 

0.0,  0.5 

35 

38.3 

0.5,  1.0 

30 

29.96 

1.0,  1.5 

13 

18.38 

1.5,  2.0 

7 

8.82 

2.0,  + “ 

6 

4.54 

Table  12.  Fixed  Input  Variable  Values. 


Input  Variable 

Value 

Engagement  Time  (sec) 

120.0 

Blue  Time  of  Flight  (sec) 

.86 

Blue  Fixed  Time  to  Fire  (sec) 

7.0 

Range  (meters) 

1000 

Blue  Rd  Reliability 

.85 

Red  Time  of  Flight  (sec) 

1.17 

Red  Fixed  Time  to  Fire  (sec) 

7.0 

Red  Rd  Reliability 

.825 
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second  for  the  MBT76  and  2800  feet  per  second  for  the  Red  tank.  The 
fixed  time  to  fire  variable  accounts  for  the  mechanical  actions  between 
rounds  such  as  recoil  and  breech  operation.  Thus  the  firing  times 
analyzed  by  the  AT  in  this  demonstration  are  human  actions  such  as 
issuing  a fire  order,  loading  the  round,  and  tracking  the  target.  A sam- 
ple of  the  model  output  is  shown  in  Figure  26. 

Derivation  of  Multiple  Response  Surfaces 

The  modified  AMSAA  Tank  Duel  Model  could  now  be  utilized  by  the 
AT  for  the  derivation  of  multiple  response  surfaces.  As  directed  by  the 
PM,  mean  time  to  fire  the  first  round  mean  time  between  rounds 

(C^),  and  probability  of  sensing  (6^)  were  chosen  as  independent  design 
variables  while  probability  of  an  MBT76  victory  (y^^)  expected  number 

of  MBT76  rounds  fired  (y2)  were  chosen  as  the  response  variables.  Based 
on  experience  by  OTE^  and  TRADOC  in  crow  performance,  realistic  ranges 
were  chosen  for  the  design  variables.  Mean  time  to  fire  the  first  round, 
human  action  component,  ranged  between  30  and  8 seconds.  Mean  time  be- 
tween rounds,  human  component,  ranged  between  30  and  5 seconds.  Probabi- 
lity of  sensing  ranged  between  .0  and  .6.  The  Red  probability  of  sen- 
sing is  somewhat  higher  since  the  Red  round  has  a lower  muzzle  velocity 

and,  consequently,  is  easier  to  sense. 

3 

A full  2 experimental  design  was  performed  on  the  AMSAA  Model. 
Table  13  details  the  design  and  the  responses.  The  values  in  parentheses 
are  the  (natural)  Independent  variable  values  while  those  outside  the 
parentheses  are  the  coded  values  as  defined  by  Equation  2.4.  Next  the 
AT  performed  multiple  linear  regression  on  this  data  using  the  Statist!- 


[ 


UJ 

LfN 

K* 

cr 

or 

flC 

• 

• 

t/^ 

O 

CO 

Q 

o 

cr 

-J’ 

• 

• 

•J 

OJ 

I 

V 

LT 

-J- 

• 

• 

in 

ho 

X 

C9 

• 

• 

X 

cr 

X 

O' 

CD 

• 

« 

vD 

n 

T 

CT 

t.r> 

UJ 

Ct 

• 

• 

o 

2 

-J 

N. 

X 

yO 

vD 

a 

or 

ir» 

• 

• 

-j- 

T 

0 

C 


Uj  • • 


Z 

T 

nj 

X 

o 

X 

«£» 

2 

c.> 

n 

or 

UJ 

U) 

• 

• 

Lu 

in 

o 

X 

(T' 

CD 

•T 

kD 

u> 

O 

X) 

X 

cr 

€=> 

ni 

K 

UJ 

• 

-j 

o 

a 

vT 

vD 

►o 

•H 

vT 

• 

cn 

o 

on 

u 

• 

• 

fn 

o 

• 

CM 

^J 

(V 

r>r' 

• 

v» 

to 

in 

o 

J- 

• 

• 

Z 

a: 

o 

K 

c? 

m 

Lu 

UJ 

ro 

UJ 

• 

• 

M 

r 

(/) 

a 

u> 

o 

(1 

M 

11 

UJ 

»-u 

U 3 

rj 

0^ 

2 

n 

CT 

r 

a 

in 

(/I 

C 

A 

CDLU— <C5J'?'2’|-I 
OI-IO  O'KOJ-l-lt-ltOUJC'' 

Z’rot') 

Uy  >-1  o >-i  00  ir'  <c  c.'  _)  a' 

_l  »-i  t-i  f\j  UJ  (D 

<■0  <1  ui  r;  O'  (V 

zujt/ik-u^-ocirsa  oo 

►->-1  n<3  ••ma'z 

LU^UJ  n 00(0 

UJ  (.ouj  eertrer'o 

j:u.zi3o  oooaa 

T»i_iujjtC)f^a.'a'a'  — ~ 
<r>-ar'ivu'ri— iQo  n UJU.' 
k-  • • 


Ul 

Z'  o 
-I  UJ 
CO  0^ 


Figure  26.  Sample  Output  From  AMSAA  Tank  Duel  Model. 
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cal  Package  for  the  Social  Sciences  (SPSS)  regression  computer  program 
(A9)  discussed  in  Appendix  C.  Figure  27  is  the  output  from  the  SPSS 
program  on  the  data  of  Table  13.  The  top  half  of  the  Figure  concerns 
while  the  bottom  half  concerns  y^-  In  the  upper  right  quadrant  of 
each  half  is  the  ANOVA  table  for  regression  and  residual  error.  The 
lower  left  quadrant  contains  the  regression  coefficients  of  the  indepen- 
dent variables.  The  following  two  response  equations  are  determined 
from  Figure  27, 


= -.037Xj^-.  023x2  + .002x^  + .344 
= -. 074x^- . 054x2  + .OlOx^  + .697 


(4.3) 


where  y^  is  probability  of  victory,  y^  is  expected  number  of  rounds 
fired,  x^  is  time  to  fire  the  first  round,  X2  is  time  between  rounds, 
and  x^  is  probability  of  sensing.  An  interesting  result  is  that  probabi- 
lity of  sensing  over  the  region  of  experimentation  is  statistically  in- 
signif leant . 

The  AT  performed  two  further  statistical  tests  on  the  data  of 
Table  13.  First  a goodness  of  fit  test  was  computed  (33).  The  residual 
sum  of  squares  is  separated  into  two  parts,  a sum  of  squares  due  to  pure 
experimental  error  and  sum  of  squares  due  to  lack-of-fit, 


SSg  = 


(4.5) 


Sum  of  square  pure  error  is  calculated  by 
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3 

Table  13.  2 Design  Variable  Values,  First  Design. 


’^l 

^2 

^3 

^1 

^2 

-1 

(20) 

-1 

(20) 

-1 

(.0) 

.407 

.795 

1 

(30) 

-1 

(20) 

-1 

(.0) 

.341 

.738 

-1 

(20) 

1 

(30) 

-1 

(.0) 

.347 

.709 

1 

(30) 

1 

(30) 

-1 

(.0) 

.307 

.581 

-1 

(20) 

-1 

(20) 

1 

(.2) 

.450 

.931 

1 

(30) 

-1 

(20) 

1 

(.2) 

.304 

.612 

-1 

(20) 

1 

(30) 

1 

(.2) 

.356 

.721 

1 

(30) 

1 

(30) 

1 

(.2) 

.310 

.637 

0 

(25) 

0 

(25) 

0 

(.1) 

.318 

.629 

0 

(25) 

0 

(25) 

0 

(.1) 

.301 

.576 

0 

(25) 

0 

(25) 

0 

(.1) 

.342 

.729 

0 

(25) 

0 

(25) 

0 

(.1) 

.329 

.739 

0 

(25) 

0 

(25) 

0 

(.1) 

.371 

.690 

c 

(25) 

0 

(25) 

0 

(.1; 

.336 

.673 

81 


82 


“pE-  y 


i =■  1 


:r2; 


Cl 


(4.6) 


i = 1 


where  are  observations  at  the  center  point  and  is  the  number  of 
center  points.  Since  residual  sum  of  squares  is  given  by  SPSS  and  sum 
of  squares  pure  error  is  computed  by  Equation  4.6,  sum  of  squares  lack-of 
fit  c*n  be  computed  from  4.5.  An  F test  statistic  is  then  computed  by 


F = SS  / (n-p-n  -1)  ' F (n-p-n  -l),n 
0 I.OF  e ' ^ e e 

SS__/n 
PE  e 


(4.7) 


where  n is  total  number  of  observations,  p is  the  number  of  variables, 
and 


m 

= y (p^-1)  (4.8) 

i = 1 

where  m is  the  number  of  different  variable  levels  and  is  the  number 

3 

of  observations  at  each  level.  For  the  first  2 design  F . = 1.86  and 

yi 

and  F-,  = 1.46,  neither  of  which  are  significant  at  the  a » .10  lev 

y2 

Therefore  the  fit  of  Equations  4.3  and  4.4  is  satisfactory. 

The  final  test  was  to  establish  a confidence  Inter'-'* 
mean  predicted  responses  at  the  center  point  of  t* • 
confidence  intervals  are  computed  by  (33) 


r 


where 


y ~t  / S < V‘  < y + t , S 

c ot /2 , rirt"!  c ct/2,n/%— 1 - 

2 2 
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(4.9) 


1 = 1 


(4.10) 


and 


i^c  = E yci/'^2 

i ■=  1 


(4.11) 


The  following  are  90%  confidence  intervals  for  the  values  of  the  mean 
predicted  responses  at  the  center  point  of  the  first  design; 


Probability  of  Victory;  .314  ^ yy^^  ^ .352 


(4.12) 


Expected  Number  of  Rounds;  .622  ^ ljy2  5_  .724 


(4.13) 


Next  the  AT  performed  a steepest  ascent  analysis,  starting  from 
the  center  point,  and  proceeding  in  directions  determined  by  Equations 
4.3  and  4.4.  Table  14  shows  the  results  of  this  optimization.  The  new 

3 

center  point  for  the  next  2 design  is  = 10.0,  5^  “ 15.67  = 16.0,  and 
.115.  Table  15  and  Figure  28  show  the  results  of  this  second  design. 
The  fitted  response  equations  for  this  design  are 


yj^  “ -.025Xj^-. 032X2". 01  Ox^  + .525 
“ -.043xj^-.  112x2". 031x2 


(4.14) 

(4.15) 
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Table  14.  Steepest  Ascent  Optimization  From  First  Center  Point. 


MOVE 

^1 

^2 

S 

^1 

A 

-1.0 

-.622 

.001 

Base 

25.0 

25.0 

.1 

.333 

+5  A 

20.0 

21.89 

.105 

.357 

+10A 

15.0 

18.78 

.11 

.425 

+15A 

10.0 

15.67 

.115 

.601 

+16  A 

9.0 

15.05 

.116 

.557 

+17A 

8.0 

14.43 

.117 

.549 

Table  15. 


Design  Variable  Values, 


Second  Design. 


^1 

^2 

*3 

^1 

^2 

-1 

(8) 

-1 

(11) 

-1  (0) 

.593 

1.190 

1 

(12) 

-1 

(11) 

-1  (0) 

.491 

1.146 

-1 

(8) 

1 

(21) 

-1  (0) 

.520 

1.093 

1 

(12) 

1 

(21) 

-1  (0) 

.528 

1.082 

-1 

(8) 

-1 

(11) 

1 (.24) 

.610 

1.499 

1 

(12) 

-1 

(11) 

1 (.24) 

.535 

1.251 

-1 

(8) 

1 

(21) 

1 (.24) 

.480 

1.028 

1 

(12) 

1 

(21) 

1 (.24) 

.438 

0.984 

0 

(10) 

0 

(16) 

0 (.12) 

.577 

1.186 

0 

(10) 

0 

(16) 

0 (.12) 

.528 

1.107 

0 

(10) 

0 

(16) 

0 (.12) 

.510 

1.168 

0 

(10) 

0 

(16) 

0 (.12) 

.514 

1.206 

0 

(10) 

0 

(16) 

0 (.12) 

.492 

1.110 

0 

(10) 

0 

(16) 

0 (.12) 

.518 

1.163 

f 
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Figure  28,  SPSS  Multiple  Linear  Regression  of  Second  Design 


86 


Again  it  is  noted  that  probability  of  sensing  is  not  statistically  signi- 
ficant. Goodness  of  fit  computations  for  this  data  are  F ..  = 2.11  which 

yi 

is  not  significant  at  a = .10  and  F ..  = 7.27  which  is  not  significant  at 

y2 

a *=  .15.  The  90%  confidence  intervals  for  the  responses  at  the  center 
point  are: 

Probability  of  Victory;  .499  ^ uy^  ^ .548  (4.16) 

Expected  Number  of  Rounds; 1.124  ^ 1.190  (4.17) 

Upon  determining  the  path  of  steepest  ascent,  a change  in 

the  probability  of  sensing,  in  a negative  direction  was  noted.  Since 

has  been  statistically  insignificant  and  clearly  does  not  improve 

in  the  negative  direction,  no  change  in  was  made  in  the  initial 

steepest  ascent  optimization.  Table  16  displays  the  results  of  this 

search.  and  have  now  reached  the  lower  bound  of  their  practical 

ranges.  From  this  point  a uni-direction  search  was  made  along  the 

direction  to  determine  if  any  further  improvement  could  be  obtained. 

Table  17  shows  the  results  of  this  uni-direction  search.  Based  on  this 

search  and  the  fact  that  has  been  Insignificant  in  two  successive 
3 

2 designs,  the  AT  decided  to  eliminate  from  further  designs  as 
statistically  Insignificant  and  fix  it  at  .3,  the  median  of  its  practi- 
cal range.  Apparently,  at  the  given  range  and  with  the  given  probabil- 
ities of  hit  and  kill,  the  ability  to  sense  a round  is  not  critical.  The 
engagement  seems  to  be  won  on  the  speed  of  firing  the  first  round  and  a 
second  round  if  required.  Given  another  scenario,  it  is  not  unreasonable 
to  expect  that  would  be  significant.  The  center  point  is  moved  to 
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Table  16.  Steepest  Ascent  Optimization  From  Second  Center  Point 


Move 

^1 

^2 

^1 

A 

-.’31 

-1.0 

o 

o 

Base 

10 

16 

.12 

.523 

5A 

9.69 

11 

.12 

.572 

8A 

9.39 

8 

.12 

.620 

9A 

9.07 

7 

.12 

.650 

lOA 

8.76 

6 

.12 

.665 

llA 

8.45 

5 

.12 

.671 

Table  17. 


Uni-direction  Search  Along 


^1 

CM 

^3 

^1 

^2 

8 

5 

.2 

.661 

1.648 

8 

5 

.3 

.696 

1.624 

8 

5 

.4 

.693 

1.737 

8 

5 

.5 

.673 

1.650 

8 

5 

.55 

.650 

1.637 

8 

5 

.6 

.658 

1.596 
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= 12.0  and  = 10.0. 

3 

For  the  third  2 design,  the  design  variable  ranges  were  chosen 
so  as  to  border  on  the  optimum  lower  bound  and  include  a large  portion 
of  the  region  of  experimentation.  Table  18  and  Figure  29  show  the 
third  design  and  its  results.  The  response  equations  are 

= -.  04  2Xj^-.  063x2  + .575  (4.18) 

= -.133xj^-.  174x2  + 1.339  . (4.19) 

The  F ..  = 2.99  and  F ^ = 4.23  are  not  significant  at  a = .10  which 

yi  y2 

justifies  elimination  of  as  a design  variable.  The  90%  confidence 
intervals  at  the  center  point  are: 

Probability  of  Victory;  .572  £ py^^^  ^ .598  (4.20) 

Expected  Number  of  Rounds;  1.332  ^ py2  ^1.404  (4.21) 

Since  the  design  now  bordered  on  the  lower  bound  of  the  practical 

region,  a second  order  design  was  employed  to  determine  if  the  fit 

could  be  improved  with  the  use  of  second  order  equations.  To  create  a 

Uniform  Precision  Rotatable  Central  Composite  Design  (UP  CCD),  axial 

points  were  added  as  shown  in  Table  19  and  a second  order  polynomial  was 

fit  using  polynomial  regression,  as  shown  in  Figure  30.  The  goodness  of 

fit  test  revealed  F . 2.66  and  F ^ * .60,  both  of  which  are  improve- 

yl  °y2 

ments  over  the  linear  model.  Thus  the  second  order  response  equations 
were  adopted: 
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3 

Table  18.  2 Design  Variable  Values,  Third  Design. 


^1 

^^2 

^1 

-1 

(8) 

-1 

(5) 

.669 

1.635 

1 

(16) 

-1 

(5) 

.581 

1.315 

-1 

(8) 

1 

(15) 

.538 

1.235 

1 

(16) 

1 

(15) 

.460 

1.021 

0 

(12) 

0 

(10) 

.577 

1.337 

0 

(12) 

0 

(10) 

.585 

1.380 

0 

(12) 

0 

(10) 

.581 

1.366 

0 

(12) 

0 

(10) 

.573 

1.332 

0 

(12) 

0 

(10) 

.609 

1.426 

Table  19.  Axial  Points  Added  to  the  Third  Design. 


*1 

*2 

^1 

^2 

-1.414  (6.344) 

0 (10) 

.591 

1.404 

1.414(17.656) 

0 (10) 

.518 

1.148 

0 (12) 

-1.414  (2.93) 

.617 

1.504 

0 (12) 

1.414  (17.07) 

.533 

1.092 
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Figure  30.  SPSS  Multiple  Polynomial  Regression  of  Second  Order  Design 
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I 

I 

I 

= -.016x^-. 006x2  + .003x^X2-.034x^-. 046X2  (^-22) 

04 2x^-. 031X2  + .027x^X2-.112x^-. 160x2  (‘‘*•23) 

To  be  meaningful  for  future  analysis,  the  coded  variables  in  Equations 

4.22  and  4.23  were  transformed  to  natural  design  variables 

y^  = -.OOIC^-. 00024^2  + .00015Cj^?2  .014^^-. 0062^2  + -629  (4.24) 

y2  = -.00026255^-. 00124^2  + .00135C^£;2  .0215^^-. 0234^2  (4.25) 

+ 1.684  . 

A canonical  analysis  was  performed  with  the  assistance  of  the 
XEIGEN  library  computer  program.  Equation  4.22  has  a stationary  point 
= (6.176,-10.99)  outside  the  region  of  experimentation,  and  eigen- 
values = -.016  and  = -.006  indicating  a maximum  surface.  Equation 

4.23  has  = (-7.29,  -21.18)  outside  the  region  of  experimentation, 
and  eigenvalues  X^  = -.061  and  X2  = -.012  indicating  another  maximum  sur- 
face. 

Response  equations  relating  the  design  variables  to  training  were 
sought  from  TRADOC  training  studies  on  armored  crew  training.^  The  ap- 
proximating relationship  between  hours  of  dry  (no  live  firing) 

training  (y^)!  in  the  region  of  experimentation  for  Equations  4.24  and 


4.25,  was  found  to  be 
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= -2. 5556?^-2. 1667^2  + 87.2009  . (4.26) 

The  approximating  equation  for  live  training  rounds  fired  (y^)»  in  the 
region  of  experimentation  for  Equations  4.24  and  4.25,  was  found  to  be 

= -2.6115^^-2.9167^2  + 107.30015  . (4.27) 

The  cost  of  training  (y^),  in  the  region  of  experimentation  for  Equations 
4.24  and  4.25,  based  mainly  on  cost  of  rounds  and  of  Petroleum,  Oil,  and 
Lubricants  (POL),  was  computed  to  be  approximately 

y^  = -234.9995^^-262.50352  + 9667.5135  . (4.28) 

Application  of  the  Optimization  Methodology  to  the  Derived  Multiple 

Response  Surfaces 

With  the  five  multiple  response  surfaces  derived  in  the  last 
section,  the  AT  was  prepared  to  present  the  PM  with  optimization  and 
analysis  of  training  effects.  The  independent  variables  for  his  given 
scenario  were  mean  time  to  fire  first  round  and  mean  time  between  rounds. 
The  response  variables  were  probability  of  victory  for  the  MBT76,  ex- 
pected number  of  rounds  fired,  hours  of  dry  training,  live  training 
rounds  fired,  and  cost  of  training.  Foreseeing  minimal  information  gain 
by  its  continued  inclusion,  the  PM  directed  that  expected  number  of 
rounds  fired  be  eliminated  from  the  optimization.  Figure  31  graphs  the 
response  surfaces  in  the  area  of  the  region  of  experimentation. 

To  acquaint  the  PM  and  themselves  with  the  surface,  and  to  al- 
leviate the  PM's  concern  about  convergence  of  the  methodology,  the  AT 
began  a sample  optimization  with  an  Impractical  point,  5j^  ” 5.0  and 
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Figure  31.  (Continued).  Glossary  for  Figures  31,  32,  33  and  34. 

Probability  of  Victory 

y^  Training  Hours 

y^  Training  Rounds 

y^  Training  Cost  in  Dollars 
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C2  30.0.  The  objective  was  to  maximize  while  constraining  to  be 
less  than  $4500.00.  Figure  32  depicts  the  operation  of  the  methodology. 

It  was  discovered  that  larger  violations  of  the  constraint  on  each  itera- 
tion hastened  convergence.  The  optimum  point  reached  was  = 11.3444 
secs  and  = 9.6965  secs  where  y^  = .5929,  y^  = 37.1966  hrs. , y^  = 
49.3968  rds,  and  y^  = $4456.22.  A validation  was  run,  as  graphed  in 
Figure  33,  by  moving  from  the  initial  point  to  the  region  of  experimenta- 
tion optimum  and  then  back  to  a constrained  optimum.  This  optimum  point, 
which  violated  the  constraint  by  $78.16  (1.7%)  was  = 11.3664  secs 
and  ^2  “ 9.2105  secs.  Thus  the  zig-zag  behavior  of  the  PM  had  converged 
to  the  optimum  constrained  point.  The  small  discrepancy  was  caused  by 
the  step-size  intervals  which  were  not  small  enough  to  permit  the  con- 
straint to  be  satisfied  exactly. 

Analysis  of  data  from  the  training  program  prior  to  OT  I and  from 
OT  I indicated  initial  crew  performance  on  the  MBT76  to  be  30  secs  mean 
time  to  fire  the  first  round  and  25  secs  mean  time  between  rounds.  Al- 
lowing for  7 secs  mechanical  fixed  time  this  converted  to  = 23.0  secs 
and  ^2  " 18.0  secs.  Performing  iterations  at  this  level  on  the  AMSAA 
simulation,  the  AT  obtained  the  data  in  Table  20  and  a 90%  confidence 
interval  about  the  probability  of  victory  of  ^ 

.3520  <_  uy^  1 .4332  (4.29) 

In  an  effort  to  predict  the  optimum  performance  of  the  MBT76,  stochastic 
simulation  iterations  were  performed  with  = 8.0  secs  and  “ 5.0  secs. 
The  results  are  shown  in  Table  21  with  a derived  90%  confidence  interval 
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Table  20.  AMSAA  Tank  Duel  Model  Output  at  ■ 23.0  and  = 18.0. 


.390 

.372 

.392 


.406 

.389 

.387 


.387 

.420 

.419 


.407 

.369 

.382 


.432 

.345 


Table  21.  AMSAA  Tank  Duel  Model  Output  at  C =8.0  and  £ «=  5 

1 >,2  ' 


0. 


.669 

.678 

.695 


.691 

.639 

.720 


.652 

.674 

.699 


.665 

.670 

.690 


.689 

.689 
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about  the  probability  of  victory  of 

.6435  1 yy^^  <.  .7165  (4.30) 

From  this  analysis  of  training  effects  on  MBT76  OT  performance, 
it  was  apparent  to  the  PM  that  his  test  personnel  must  receive  further 
training.  Indications  were  that  when  OT  I data  was  simulated  in  two- 
sided  combat,  the  MBT76  would  not  be  victorious.  Yet  with  proper  crew 
training,  the  MBT76  would  be  victorious  68%  of  the  time.  Certainly  fur- 
ther OT's  must  be  conducted  at  a training  level  closer  to  optimum. 

Much  as  a tactical  unit  commander  would  do,  the  PM  and  the  AT  de- 
signed a training  program  for  the  test  personnel.  Their  objective  was 
to  maximize  probability  of  victory.  The  test  cycle  timetable  and  budget, 
however.  Imposed  constraints  of  no  more  than  50  hours  dry  training  per 
crew,  no  more  than  55  training  rounds  per  crew,  and  no  more  than  $5500.00 
training  cost  per  crew.  With  this  problem  formulation,  the  PM  and  AT 
began  optimization  utilizing  the  adapted  Interactive  Vector  Maximal 
algorithm.  Figure  34  graphs  the  four  iterations  of  the  methodology  re- 
sulting in  an  optimum  point  of  = 10.7  secs  and  = 8.2  secs.  Output 
from  the  optimization  methodology  predicted  that  training  to  this  pro- 
ficiency would  result  in  a probability  of  victory  of  .6099.  The  pre- 
dicted training  effort  to  arrive  at  this  level  was  41.9  hours  of  dry 
training  per  crew,  55.2  live  rounds  fired  per  crew,  and  a cost  of 
$4982.62  per  crew. 

To  confirm  these  results  the  AT  ran  the  simulation  at  these  levels 
yielding  the  results  in  Table  22  and  a 90%  confidence  interval  around  the 
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probability  of  victory  of 

.5377  1 yyj^  _<  .6547  (4.31) 

Further  sensitivity  analysis  around  the  optimum  point  was  accomplished 
by  Iterating  the  adapted  algorithm  in  varied  uni-direction  searches  from 
the  optimum  point.  The  searches  are  listed  in  the  following  tables: 
Table  23  toward  point  (8. 0,5.0),  Table  24  toward  point  (8.0,15.0),  Table 
25  toward  point  (16.0,  5.0),  and  Table  26  toward  point  (16.0,  15.0). 

Upon  analyzing  this  sensitivity  analysis,  the  PM  was  satisfied 
with  the  proposed  training  program  and  its  crew  performance  objectives. 
Implimentatlon  of  the  training  program  was  begun  immediately.  Future 
OT  reports  to  the  ASARC  included  a section  analyzing  the  training  level 
of  the  test  personnel  and  the  effect  of  training  on  the  performance  of 
the  MBT76  in  two-sided,  European  type  conflicts. 


lable  22.  AMSAA  Tank  Duel  Model  Output  at  = 10.7  and  = 8.2. 


589 

.592 

.662 

.619 

.563 

567 

.650 

.596 

.578 

.590 

561 

.587 
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.6099 

.6129 

.6157 

.6185 

.6212 

.6239 

.6264 

.6289 

.6313 

.6336 

.6359 

.6381 

.6402 

.6422 

.6441 

.6460 


Table  23.  Sensitivity  Analysis  Toward  (8. 0,5.0). 


1.4548 

41 .9288 

1 .4653 

42.8618 

1.4757 

43.7947 

1 .4859 

44.7276 

1 .4959 

45.6605 

1.5057 

46.5934 

1 .5154 

47.5263 

1.5249 

48.4593 

1.5341 

49.3922 

1 .5432 

50.3251 

1 .5522 

51 .2580 

1 .5609 

52.1909 

1 .5694 

53.1238 

1.5778 

54.0568 

1 .5860 

54.9897 

1 .5940 

55.9226 

55.2458 

4982.6208 

56.3513 

5082.1132 

57.4567 

5181.6056 

58.5622 

5281 .0980 

59.6677 

5380.5904 

60.7731 

5480.0827 

61.8786 

5579.5751 

62.9841 

5679.0675 

64.0896 

5778.5599 

65.1950 

5878.0522 

66.3005 

5977.5446 

67.4060 

6077.0370 

68.51 14 

6176.5294 

69.6169 

6276.0217 

70.7224 

6375.5141 

71 .8279 

6475.0065 
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Table  24.  Sensitivity  Analysis  Toward  (8.0,15.0). 


6099 

1 .4548 

41 .9288 

55.2458 

4982.6208 

6077 

1 .4474 

41  .5850 

54.5834 

4923.0080 

6054 

1 .4395 

41.1211 

53.9211 

4863.3951 

6030 

1.4311 

40.7173 

53.2587 

4803.7823 

6004 

1 .4881 

40.3134 

52.5963 

4744.1694 

5977 

1 .4125 

39.9096 

51.9340 

4684.5565 

5949 

1 .4024 

39.5057 

51.8716 

4684.9437 

5920 

1 .3917 

39.1019 

50.6092 

4565.3308 

5890 

1 .3805 

38.6980 

49.9469 

4505.7180 

5859 

1 .3687 

38.2941 

49.8845 

4446.1051 

5826 

1 .3563 

37.8903 

48.6221 

4386.4982 

5792 

1 .3434 

37.4864 

47.9598 

4386.8794 

5757 

1 .3899 

37.0826 

47.2974 

4867.8665 

5721 

1 .3159 

36.6787 

46.6350 

4207.6537 

5684 

1 .3013 

36.8749 

45.9727 

4148.0408 

5645 

1 .8862 

35.8710 

45.3103 

4088.4879 

5606 

1.2705 

35.4672 

44.6479 

« 

4088.8151 

5565 

1 .2542 

35.0633 

43.9856 

3969.8022 

5583 

1.2374 

34.6595 

43.3232 

3909.5894 

5480 


1 .seoo 


34.8556 


48.6609  3849.9765 
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Table  25.  Sensitivity  Analysis  Toward  (16.0,5.0). 


6099 

1 .4548 

41 .9288 

55.2488 

4982.6208 

6096 

1 .4529 

41.5893 

55.0191 

4962.2205 

6091 

1 .4505 

41.2498 

54.7924 

4941.8202 

6063 

1 .4474 

40.9102 

54.5658 

4921.4198 

6074  . 

1 .4437 

40.5707 

54.3391 

4901.0195 

6064 

1 .4395 

40.2312 

54.1124 

4880.6192 

6051 

1 .4346 

39.8917 

53.8858 

4860.2188 

6036 

1 .4291 

39.5521 

53.6591 

4839.8185 

6020 

1.4230 

39.2126 

53.4324 

4819.4182 

6002 

1 .4163 

38.8731 

53.2058 

4799.0178 

5982 

1 .4090 

38.5336 

52.9791 

4778.6175 

5960 

1 .4011 

38.1940 

52.7524 

4758.2172 

.5937 

1.3926 

37.8545 

52.5257 

4737.8166 

5911 

1.3835 

37.5150 

52.2991 

4717.4165 

5684 

1.3737 

37.1754 

52.0724 

4697.0162 

5855 

1.3634 

36.8359 

51.8457 

4f 76. 6 158 

5824 

1.3525 

36.4964 

51.6191 

4656.2155 

5791 

1 .3409 

36.1569 

51.3924 

4635.8152 

5756 

1.3288 

35.8173 

51.1657 

4615.4148 

5720 

1.3160 

35.4778 

50.9391 

4595.0145 

i06 


Table  26.  Sensitivity  Analysis  Toward  (16.0,15.0). 


6099 

1 .4548 

41.9288 

55.2458 

4982.6208 

6051 

1 .4375 

40.4489 

53.4840 

4824.0610 

6000 

1 .4198 

38.9690 

51 .7222 

4665.5012 

5948 

1 .4017 

37.4891 

49.9605 

4506.9414 

5894 

1 .3831 

36.0092 

48.1987 

4348.3816 

5838 

1.3641 

34.5294 

46.4369 

4189.8218 

5780 

1 .3446 

33.0495 

44.6751 

4031 .2620 

5721 

1 .3246 

31.5696 

42.9134 

3872.7022 

5659 

1.3042 

30.0897 

41.1516 

3714.1424 

5596 

1 .2834 

28.6098 

39.3898 

3555.5826 

5531 

1.2621 

27.1299 

37.6280 

3397.0228 

5463 

1 .2403 

25.6500 

35.8663 

3238.4630 

5394 

1 .2181 

24.1701 

34.1045 

3079.9032 

5324 

1.1954 

22.6902 

32.3427 

2921 .3433 

5251 

1.1723 

21.2103 

30.5809 

2762.7835 

5177 

1.1488 

19.7304 

28.8192 

2604.2237 

5100 

1 . 1 248 

18.2505 

27.0574 

2445.6639 

5022 

1.1003 

16.7706 

25.2956 

2287.1041 

4942 

1 .0754 

15.2907 

23.5338 

2128.5443 

4860 

1.0500 

13.8108 

21  .7721 

1969.9845 
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CHAPTER  V 

CONCLUSIONS  AND  RECOMMENDATIONS 

Conclusions 

The  field  of  multiple  response  surface  methodology  was  found  to 
consist  largely  of  applications  of  nonlinear  programming  techniques  to 
problem  formulations  of  a primary  and  a constraint  response.  Contempor- 
ary efforts  continue  to  enhance  this  area  with  application  of  further 
nonlinear  programming  algorithms.  This  research  is  an  initial  effort  to 
optimize  multiple  response  surfaces  by  means  of  the  Geof f rion-Dyer  Inter- 
active Vector  Maximal  algorithm. 

A modified  version  of  the  Interactive  Vector  Maximal  algorithm 
was  found  to  be  well  suited  to  the  optimization  of  multiple  response 
surfaces.  Various  practical  region  of  experimentation  boundary  defini- 
tions are  easily  incorporated  into  the  methodology.  Algorithm  assump- 
tion violations  were  present  in  saddle  and  ridge  systems.  Methods  for 
optimization  in  the  presence  of  such  assumption  violations  were  devised. 
The  methodology  was  shown  to  converge  and  to  satisfy  the  Kuhn-Tucker 
conditions  necessary  for  optimality.  FORTRAN  IV  computer  programs  were 
written  to  perform  the  procedure  on  a CDC  CYBER  74  computer. 

It  has  been  demonstrated  that  through  computer  simulation  and 
response  surface  methodology,  OTEA  can  extend  the  analysis,  scope  and 
optimization  of  OT  results.  A mutually  supporting  relationship  between 
OT's  and  computer  simulations  was  discussed.  The  importance  of  the 
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military  decision  maker  and  the  benefits  accrued  by  his  participation  in 
the  methodology  of  this  research  have  been  discussed.  An  application  of 
the  methodology  to  the  analysis  of  the  effects  of  training  in  0T*s  has 
been  demonstrated, 

Recommenda  t ions 

This  research  generated  several  recommendations.  The  suboptimi- 
zation algorithm  of  the  methodology  should  be  investigated  for  an  algo- 
rithm which  would  better  optimize  a saddle  and/or  a ridge  system.  A 
nonlinear  algorithm  such  as  Zoutendijk's  Method  or  the  Conjugate  Direc- 
tion Method  should  be  considered.  Another  aid  in  this  area  might  be  the 
simultaneous  utilization  of  a visual  display  of  the  response  surface  so 
that  the  decision  maker  might  better  follow  the  implications  of  his  op- 
timization movements.  Some  of  the  other  multiple  objective  algorithms 
mentioned  in  Chapter  II,  such  as  SEMOPS,  should  be  investigated  for  ap- 
plicability to  multiple  response  surface  optimization.  The  design  of 
OT's  should  be  analyzed  from  a design  of  experiment  viewpoint.  Utiliza- 
tion of  fractional  designs  would  greatly  reduce  the  number  of  replica- 
tions, thereby  perhaps  making  actual  OT  data  available  for  analysis  by 
this  methodology.  Finally  OTEA  should  implement  the  methodology  of  this 
research  to  enhance  and  improve  the  resulting  analysis  of  operational 
tests.  There  are  several  excellent  military  computer  simulations  avail- 
able. Hopefully  this  research  and  its  references  can  serve  as  a guide 
in  the  implementation  of  multiple  response  surface  optimization  and 
analysis . 
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APPENDIX  A 


This  appendix  contains  two  programs  utilized  to  generate  the 
normal  deviates  necessary  for  input  to  the  AMSAA  Tank  Duel  Model.  The 
first  program  utilizes  an  internal  CDC  CYBER  74  U(0,1)  generator  to 
generate  U(0,1)  deviates.  The  second  program  transforms  these  uniform 
deviates  to  normal  deviates  of  specified  mean  and  variance  through  the 
use  of  the  Fishman  equations. 
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c 

C**»**TH1S  HHUGKAM  GtNtHAItS  U(0,l)  DtVIAItS  AND  STURtS 

c*****iN  A file. 

C 

RKIK.RAM  UNGEN(InRuT,OUTHUI,  lAREi,  T APEbs  1 NPU  T , 

* 1 APt6=0UTPUl ) 

DiMLNblON  RAN(20()J 
NUM=POO 

call  KANSETIO) 

Dli  POO  1 = 1, NUM 
RAN ( I J =RANF ( 0 } 

200  CUNl INUE 

WRITE(5,»)(KAN(1),I=1 ,NUM) 

SI  UP 
E ND 


c 

C*»***IH1S  ^^k^J{;KAM  IRANSFtJKMS  U(0,1)  UfcVIATtS  INTU  N(0,1) 
VlAItJi  UF  GIVtN  MLAN  ANU  VAKlANCt. 
f. 

RKObWAM  NURM(  INRUI  ,Ul)IPUT,  TARti,  T AP  t b = I NPU  T , 

* 1 APt  b = OUTPU ( ) 

DIMLNvSION  RAN(^00),KANOKM(?00) 

NUM  = £?U0 

PI=P.*i. laibRRbbS 
L 

C*«***THli,  GlATLMtNl  KfcAGii  I Ht  U(0,1)  FKt)M  A FILE, 

C 

we  Al  * i,  * ) I HAN(  J ) , J=  I , NUM) 

C 

C»***»lHlb  bECTiON  CUMPUIEb  The  NURMAL(0,1), 

c 

10  0 PKIM  S4H 

SOR  F URMA  I ( *wrlA  I AKfc  NORMAL  MLAN  AND  VAKIANLF*) 
RtAl>(S,*)URMO,ORMVAR 
C 

C**»**lntbF.  ARE  IMF  FISHMAN  EUUATIUNS. 

C 

DO  bbo  J=1,NUM,R 

DUMMY  =bURT  ( - * URMV  AR*  ALOb(  RAiN(  J ) J ) 

RANUWM(J)=URMU  + DUMMr*L()b(PI*RAN(Jtl)) 
RANURM(J+l)=ORMU  + DUMMr*SlN(PI*RAN(J*n) 

SbO  ( UN  1 1 NUE 

-vRl1E(b,*;URMU,UHMVAR,(RANaRM(JJ,J=l,  NUM) 
bUTU  100 
S 1 OP 
END 


APPENDIX  B 


This  appendix  contains  the  AMSAA  Tank  Duel  Model  simulation  mod- 
ified for  use  in  this  research.  Several  of  the  Inputs  have  been  fixed 
or  rendered  stochastic  as  discussed  in  Chapter  IV  of  this  thesis.  Fol- 
lowing the  listing  of  the  simulation  is  an  example  of  an  input  data  file 
utilized  by  the  simulation.  Figure  26,  page  78,  is  an  example  of  the 
simulation's  output. 
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C 

C*****THIS  IS  THE  AMSAA  TANK  DUEL  SIMULATI0N  M0DEL 
C 

PR0GRAM  TANK(  INPUT/  0UTPUT/ TAPES/ TAPE5«INPUT/ TAPE6>=0UTPUT) 
DIMENSI0N  TMDB(A5>/TMDR(45>/SDB(4S>/SDP(45}/SKB(45)/SKR 
*(A5) 

REAL  KB(45) /KR(A5)/M(4O/AO}/N(4O/4O)/NOF/N0DEC 
INTEGER  P^NGE 

DATA  SIGMA/ BLUE/ RED/ TCUT/ LS/TFB/ TTB/ IDl / 1D2/ IDS/ RANGE/ 
IRELB/TFR/TTR/ ID4/ID5/ ID6/RELR/. 5/AHBLUE/SHRED/ J 20 .0/0/ 
2.86/7./SHBLU/SHBLU/ 3HBLU/ 1 000/ .85/ 1 . 1 7/ 7 . / SHRED/ SHRED/ 
33HRED/ .825/ 

100  READ! 3/ 91 2)  TBl / TBS/BPH 1 /BPHH/BPHS/BPHL/BKHl / 
IBKHH/BKHS/BKHL/BS 

READ<  3/ 912)  TRl / TRS/ RPH 1 / RPHH/ RPHS/RPHL/ RKH 1 / 

1 RKHH/HiiHS/ RKHL/ RS 

IF  (LS.EC.O)  WRITE! 6/ 90A)BLUE/ RED/ TCUT 
IF  (LS.NE.O)  WRITE(6/905)BLUE/LS/RED/TCUT 
WRITE(6/916>RANG£/ID1/ID2/ID3/IDA/1D5/ID6 

WR I TEC  6 / 9 1 7 ) TFB/ TTB/ TB 1 / TBS / BPH 1 / BPHH/ BPHS / BPHL/ BKH 1 / BKHH/ 
1 BKHS/ BKHL/ BS/ RELB/ TFR/ TTR/ TRl / TRS/ RPH 1 / RPHH/ RPHS/RPHL/ 
♦RKHl 

2RKHH/ RKHS/ RKHL/ RS/ RELR 

CALL  KASFTCKB/SKB/ J0UTB/ BKH 1 /BKHH/ BKHS /BKHL/ BPHl/ BPHH/ 
♦BPHS/ 

1 BPHL/ BS/ RELB) 

CALL  KASFTC  KR/SKR/ J0UTR/RKH1 /RKHH/RKHS/RKHL/RPHl /RPHH/ 
♦RPHS/ 

IRPHL/ RS/RELR) 

J0UT=M1NO{AO/MAXO<U0UTB/J0UTR) ) 

SFTB=0.0 
SFTR=0 .0 

IF  (TFB. GT. TFR)  SFTB»TFB-TFR 
IF  (TFR. GT. TFB)  SFTR»TFR-TFB 
TMDBC 1 )=TB1 
SDBC 1 )=SIGMA 
D0  120  I«^2/45 

120  CALL  C0NL0G(TBS/SIGMA/TMDB(I-1 )/SDB(I-l )/TMDB(I)/S0B 

♦ CD) 

TMDRC 1 )»TR1 

SDRC 1 )=SIGMA 

IF  (LS.ECl.O)  G0T0  130 

♦♦♦♦♦adjust  red  times  F0R  HEADSTART 

TSAVE-TMDRC 1 ) 

CALL  C0NL0G(TMDRC 1 )/SDR( 1 )/ TMDBC LS )/ SDBC LS) / TMDRC 1 )/SDR 

♦ CD) 

130  00  140  ls2/40 

140  CALL  C0NL0GCTRS/S1GMA/TMDRCI-1  )/SDRCI-l)/TMDRCD/SDRCD> 
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t>0  ISO  1-1^45 

150  TMDB(I>«TMDB<I)+FL0AT(I-1 )*TTB+SFTB 
IF  (LS.LE.i ) G0T0  170 
TSAVE=TTB*( FL0AT( LS- 1 ) ) 

00  160  I-U40 

160  TMDR(I)»TMDR(I)+TSAVE 
170  00  180  1=1^40 

180  TMDRC I >»TMDRCI)+FL0AT( I-l )*TTR+SFTR 
C 

C***»*C0MPUTE  AVERAGE  NUMBER  0F  ROUNDS  FIRING  ASSUMING  N0 
Cj*****KILLS. 

C 

RNDB»NDF<AL0G( (TCUT/TMDB( 1 ) ) )/SDB< 1 > ) 

BNDR«NOF<AL0G( ( TCUT/TMDR( 1 ) ) )/SDRC 1 ) ) 

L»40-*-I.S 
00  190  l‘=2,L 

190  RNDB»RNDB+NDF(AL0G(  (TCU,T/TMDB<  I ) ) )/5D&(  I ) ) 

00  195  1=2,40 

195  RNDR=RNDR*NDFCAL0G( C TCUT/TMDR( I > i ) / SDR< I ) ) 

C 

C*****M<I,J)  GIVES  THE  PROBABILITY  THAT  BLUE  FIRES  HIS 
C»»»**I  TH  R0UNO  BEFORE  RED  KILLS  WITH  HIS  J TH,  AND 
C*****B0TH  BEF0RE  TOUT. 

C*****NO,J)  GIVES  THE  RESULTS  FOR  RED. 

C 

D0  200  I = l,i;0UT 
DO  200  J=1,«;0UT 

MC  I,  J)*PABAT(  TOUT,  TMDBCI+LS),  TMDRC  J),SDB<  I -t-LS  > , SDRC  J ) ) 
200  N( I,J)*PABAT( TOUT, TMDRC 1 ) , TMDBC J+LS ) , SDRC I ) , SDBC J+LS ) ) 
D0  210  I«1,J0UT 
DO  210  U=2,J0UT 
K=U0UT+2-J 

MC I,K)«MC I,K)-MC 1,K-1 ) 

210  NC I,K)*NC I,K>-NC i,K-l ) 

PU1NB=0  .0 
PWINR=0  .0 
ANRB=C  .0 
ANRR>0 .0 

IF  CLS.EQ.Ol  GOTO  225 
DO  220  I=1,L5 

TSAVE=NDFC AL0GC  C TCUT/TMDBC 1 ) ) )/SDBC I ) ) 

PVlNB=PVlNB-fKBC  I)*TSAVE 
220  ANRB=ANRBfFL0ATCI}4>KBCl)*TSAV£ 

ANRBaANRB^FLOATCLSX'SKBCLSloKRC  1 >*NC  1,  1 > 

225  DO  230  LOO*1,J0UT 

PVINB«PVlNBfMCLQQ,  1 }4>KBC  LS-^LOQ) 

230  ANRB>ANRB-«-FL0ATCLS-^LQQ>*HCLQQ,  1 }«CKBCLS-^LQQ>-^KRC  1 }»SKBC 
ILS-fLQQ)  > 

DO  235  LQ«2,J0UT 
DO  235  LQQ=1,J0UT 

PVINB>PVINB>KBCLS-^LClQ)*MCLOCi,LC}*SKRCLQ-l  } 


115 


235  ANRB>ANRB-*-FL0AT<LS«LQQ)*M(LQQ«LQ>4>(KfiCLS+LQQ>-«-KR(LQ)« 
lSKB(LS-»^LaQ)  }*SKR(LQ-1  } 

IF  (LS.EQ.O  G0T0  245 
D0  240  LQGsl«J0UT 

PVlNR:^PVlNR-fKR(LQQ)4iN(LQQ«  1 )4SKB(LS) 

240  ANRR>=ANRR-^FL0AT(LQQ}*NCLGQ4  1 ) «(  KR(  LOG ) -t-SKRC  LQQ ) «KBC  LS-«- 1 ) ) 

1*SKB(LS) 

G0T0  260 

245  D0  250  l.GQ»UJ0UT 

PV1NR>PV1NR-»^KR(LQQ>>^N(LGQ«  1 > 

250  ANRR«ANRR-*-FL0AT(LQG)*N(LQQ4  1 )*(KR(LQQ)-t-SKR(LQQ}>t‘KB(  1 )) 

260  D0  270  LQ=2^J0UT 
D0  270  LGG=1>J0UT 

PWlNR*PWl»JR+KR(LGQ)*N(LQQ^LQ)»SKBCLGfLS-l) 

270  ANRR>ANRR-^FL0AT(LQQ><»N(LQQ«LQ>*SKB(LQ-»-LS>1  }«CKR(LQQ}4- 
lSKR<LQQ)*iiB(LS  + LQ)) 

N0DEC=1 .O-PWINB-PWINR 
ANRB-ANRB4N0DEC4RND& 

ANRR«ANRR4-N0DEC«RNDR 

VR1T£<6«915)BLUE«PV1NB«RED«PV1NR4N0OEC.»BLUE«ANRB«RED« 
lANRR 
G0T0  100 

904  F0RMAT( ///10X,*A  MEETING  ENGAGEMENT  BETWEEN*^ AlO^ ♦AND* 
l,A10/10X,*ThE  TIME  LIMIT  I S*> F8 . 2, ♦SEC0NDS* ) 

905  F0RMATC///IOX*A1O,*  THE  DEFENDER  HAS  A*^I2,*R0UND 
AHEADSTART*^ 

1 /10X,A10>*  IS  THE  ATTACKER*/! 0X>*THE  TIME  LIMIT  IS*> 

2 F6,2,*  SECONDS*} 

912  F0RMAT<2F5.2>9F5.4} 

915  F0RMAT( lOX, *PR0B(*,A5^*  WI NS ) “*/ F6 . 3/ 1 OX, *PR0BC *# AS* 

1*  VINS}-*,F6.3/1OX,*PR0B(N0  DEC I S I 0N > »*, F6. 3/1 OX, *E( RDS 
4F0R*, 

2 A5,2H}-,F9.3/10X,*E(RDS  F0R  *, A5, 2H } «, F9 . 3 ) 

916  F0RMAT( lOX, *RANGE  IS*, 15,*  METERS*/ 1 OX, *BLUE  DATA  IS  * 
1,3(A3, 1X)/10X,*RED  DATA  IS  *, 3<A3, 1X)/9X,3HTFL,4X,2HTT, 

2 4X, 2HT 1 , 4X, 2HTS, 2X, 3HPH 1 , 2X, 3HPHH, 2X , 3HPH  S , 2X , 3HPHL, 2X, 
33HKH 1 , 2X, 3HKHH,2X, 3KKHS, 2X, 3HKHL, 3X, 2HPS, 3X, 3HREL> 

917  F0RMAT< 1 X, 4HBLUE, 1 X,4F6 .2, 9F5. 3, F5 .2/ IX, 3HRED, 2X, 4F6 . 2, 
19F5.3,F5.2} 

STOP 

END 

C 

C*****THIS  SUBROUTINE  COMPUTES  THE  MEDIAN  AND  STANDARD 

C*****deviati0n  for  convolution. 

C 

SUBROUTINE  C0NLOG(X1 , SI GX, ETA, S I6Y, ZETA, SIGZ) 

XBAR-X1*EXP( .5*SIGX*S16X} 

YBAR«ETA*EXP( . 5*SI GY*SI GY ) 

SSX»XBAR*XBAR*(EXP<SIGX*S1GX}-1 .0} 

SSY=YBAR*YBAR*<EXP( SIGY*SIGY)-1 .0} 
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ES16Z>1  .0-»(  ( SSX-*^SSY>/(  (XBAR-«-YBAR>**2>> 
Z£tA«(XBAR-*'YBAR>/SQRT(ESlGZ) 

S1GZ>SGRT(AL0G(£S1GZ>> 

RETURN 

END 

C 

C**#**THIS  SUBR0UTINE  C0MPUTES  THE  KILL  AND  SURVIVAL 
C4<«**4<F0R  the  TW0  TANKS. 

C 

SUBR0UT I NE  KASFTC K/ SK, J0UT^ KH 1 / KHH, KHS^ KHL, PH 1 < PHH, PHS^ 
1PHL,S,R) 

D1MENSI0N  SKCAS) 

REAL  K(45>^KH1>KHH/KHS4KKL>L 
00  100  1>2«4S 
K( 1>«0.0 
100  SKCD^O.O 

K(  1 >sPHl>t<KHl4iR 
SK< 1 )*! .0-K< 1 ) 

L»1  .0-S 

X2«PHl>t><  1 .0-KHl«R) 

X3=( 1 .0-PHl )*S 
X4-<  1 .0-PHl  )*L 
A12»PHH*KHH«R 
A13°PHS*KHS4R 
AU«PHL*KHL*R 
A22=PHH*{ 1 .0-KHH*R) 

A23»PHS*( 1 .0-KHS*R) 

A24»PHL*( 1 .0-KHL*R) 

A32»< 1 .0-PHH)*S 

A33»( 1 .0-PHS>*S 

A34»( 1 .0-PHL)*S 

A42«( 1 .0-PHH)*L 

A43=< 1 .0-PHS)*L 

A44b(  1 .0-PHL>*L 

00  130  1«2«45 

K(  1 }-Al2*X2>Al  34<X3-*-A14«X4 

X3P*A32*X2+A33*X3+A34*X4 

X2P«A22«X2-i-A23«X3-«-A24«X4 

X4P  >A42  *X2  -*^443  4X3  +444  *X4 

X2 »X2P 

X3-X3P 

X4»X4P 

J0UT=I 

SKCl)«SK<I-l )-KCI) 

IF  (l.LT.ll)  G0T0  130 
IF  (SK(1-5>.LT..0005>  G0T0  135 
130  C0NT1NUE 
1 35  Return 

END 

C 

C*****THIS  FUNCTI0N  COMPUTES  THE  ELEMENTS  0F 


1«J)  AND  Nd^U). 

C 

FUNCTIDN  PABAT<T^TA,TB,  SA/SB) 
REAL  NDF 
EXTERNAL  PAFINT 
C0KM0N/PAF/A>B 
IF  <SA.GE.O.>  G0T0  2 
X=T 
A«TA 
Bs=TB 
G0T0  7 
2 X«T/TA 

IF  (X.GT. .0000001 > G0T0  5 
PABAT»0 . 

RETURN 

5 X»AL0G<X)/SA 

A=AL0G<TA/TB)/SB 
B=SA/SB 
7 C=B*B+1 . 

D»A/SQRT(C) 

E=A+B*X 

IF  (X*X+E*E.LT.25. ) G0T0  30 
IF  (E.LT.O.)  G0T0  10 
PABAT=1 . ~NDF(D> 

RETURN 

10  IF  (X.GT.O.)  G0T0  20 

PABAT=NDF(X) 

RETURN 

20  PABAT=NDF(X) 

IFCA#B/C .LT.X)  RETURN 
PABAT=PABAT- NDF  < D ) 

RETURN 

30  F=«SQRT<25.*C-A*A) 

Ab»A*B 
UZ=-A/B 
DIM»(-AB-F)/C 
UlP«( -AB+F>/C 
BR=-5. 

IF  (UZ.GE.-5.)  BR-UIM 
TS=5. 

IF  <UZ.LT.5.)  TS-UIF 
IF  CX-bR.LE.TS-X)  60T0  40 
CALL  SAMS0N(PAF1NT«G«X«TS.»  .0001  ) 
PABAT*1 .-NDFCD)-NDFCTS>+NDF(X)+G 
PABA  T«ABS ( PABAT ) 

RETURN 

40  CALL  SAMS0N<PAFINT«G«BR«X« .0001 } 
PABAT»NDF(X)-G 
PABATaABS  < PABAT ) 

RETURN 


r 
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END 

FUNCTI0N  PAFINTCU) 

REAL  NDF 
C0MM0N/PAF/A,B 

PAf INT».3989422803*EXP( -U*U/2 . )*NDF< A+B*U) 

RETURN 

END 

SUBR0UTINE  SAMS0N(FUN,R*A,B/EPS> 

IF  (B-A.GE* .OOOJ > G0T0  18 
R»0. 

RETURN 

18  EPS1«EPS 
NT»0 
N-1 
M=1 
XU*B 
XL»A 

H = (XU-XL)/2  . 

HBAP-0 . 

FJ»H*(FUN(XU)+FUN(XL) ) 

FIBAR= 10000. 

1 S»0. 

X*XL+H 

2 S=S+FUN<X) 

X=X-*-HBAR 

M=M-1 

IF  CM)  3^3,2 

3 F1=FJ+A.*H*S 

IF  CFIBAR)  4,5^4 

4 £RR=AfcSC (FIBAR-FI )/FIBAR) 

IF  CERR-EPSI)  9,5,5 

5 IF  <NT-13)  7,9,9 

7 NT«NT+1 

FIBAR«FI 

FJ  = CFl-*-FJ)/4. 

HBAR-H 

H=H/2. 

N«2«N 
M»N 
G0T0  1 

9 R=FI/3. 

RETURN 

END 
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C**#**THIS 

C 


FUNCT10N  IS  THE  CU  MULATIVE  N0RMAL  DISTRIBUTI0N 


REAL  FUNCT10N  NDF(X) 

NDF»0 . 

AX»ABSCX) 

IF  (AX.GE.5.)  G0T0  3 

NDF=( ( ( < ( .5383E-5*AX+.A88906E-A)*AX+.380036E-A)*AX 
1-^. 0032776263  )*AX-^. 021  1 4 1 006 1 > «AX-«- .0498673469  ) *AX-^  1 . 
NDF=.5/<  CNDF**8)**2J 
IF  (X.GE.O.)  NDF-l.-NDF 
RETURN 
END 
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23.00 1 6. 00.  7997. 6394. 7932 .8023.5417.8509.4977.4936.6000 
06.5410.04.6754.7288.7192.6658 .3920.8280.4780.4700.5398 

23.0018.00. 7340 .8432.8220.8268 .5016.8405.5029.51 19.6000 
08.0411 .76.5681 .7692.7328.5529.41 13.6200.4135.5238.4964 

23.0018.00. 7398.8720.8417.7770.4618.8761 .5435.4491 .6000 
09.7609.98.6290.7826 .6420.6599.4455.7613.4477.4436.4980 

23.0018.00. 7831 .8917.8016.7523.5500.8369.4797.4947.6000 
07.9710.98.6494.6920.7280 .6499.4529.7635.4619.4935.5795 

23.0018.00 . 6128.851 6.78 18 .8372.4788 .8600.4633.5860.6000 
08.9811 .32.5125.7780.7200.5769.3991 .6738.4297.4447.5217 

23.0016.00. 7525.6316 .6500.7487.5192.8671 .5226.4913.6000 
09.3209.04.6423.7700.661 3.5796.4133.7955.5360.4726.5233 

23.0018.00. 7225 .9000.7788.7989  .5328 .8197.4550.4734.6000 
07.0411.20.6302.71 13.6635.7167.4413.7977.4050.4234.5203 

23 .0018.00. 8254.8288 .8192.8156 .4420.8646.51 13.4902.6000 

09.2011 .00. 5417.7135.7736.6194.4613.7936.4402.4188.5271 

23.0018 .00 .  7180 .8692.8328.7029.5280.8605.4688.5238.6000 
09.0009.35.5450.8238.6955.6221.4738.8029.4658.4427.5338 

23.0018.00. 7790.8628.7420.8099.5200.8298.5158.4927.6000 
07.5309.58.71 12.7455.6977.6171 .4585.61 19.4827.4343.5571 

23.0018 .00 . 7994.7920.6280 .7999.4613.6309.5065.5327.6000 
07.5812.35.5933.7477.6936.6286.4536.8434.4198.4605.4874 

23.0018.00. 6625.8780 .8200.7269.4635.8885.4843.5036.6000 
10.3510 .39.5965.7436.7029.6398.4539.7491 .4913.4295.5100 

23.0018.00 . 7923.6700.761 3.7296.5738.8477.4698 .5105.6000 
08.3910.44.5904.7529.71 19.6791.4368.7797.4077.4513.5211 

23.0018.00. 7802.81 13.7635.6667 .4955.8488.5039.5413.6000 
06. 4410. 34. 6043.76  I 9.7435. 56  I 8.4533. 7947. 4630. 46 15.4979 
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APPENDIX  C 

This  appendix  contains  two  procedure  files  and  their  respective 
input  data  files  for  utilization  with  the  SPSS  Multiple  Linear  Regression 
program.  The  first  procedure  and  input  files  are  examples  of  those 
utilized  for  multiple  linear  regression.  The  second  files  are  examples 
of  those  utilized  for  multiple  polynomial  regression.  Examples  of  SPSS 
Multiple  Linear  Regression  output  can  be  found  throughout  Chapter  IV  of 


this  thesis. 


5.  RUN  NAME 

5.005  MULTIPLE  LINEAR  REGRESSI0N  0N  TANK 
10.  VARIAbLE  LIST 

10.005  Tbl /TBS^PS^PV^LP 

30.  INPUT  FeRMAT 

30.005  FIXED<3F6.3>FA.3>F5.3) 

AO.  N0.  0F  CASES 

AO. 005  lA 

50.  REGRESSION 

50.001  VAFIABLES»TBU  TBS,PS^PV>  ER/ 

50.002  REGRESSI0N*PV  WITH  TB 1 # TBS# PS ( 2 ) / 

50.003  REGHESS10N=ER  WITH  Tbl # TbS#PS( A) 


-1  .000-1  .000-1 
0 1 .000-1  .000-1 
-1 .00001 .000-1 
0 1 .0000 1 .000-1 
- 1 .000-1  .00001 
01 .000-1  .00001 
-1  .00001  .00001 
0 1 .0000 1 .0000 1 
00 .00000  .00000 
00.00000.00000 
00 .00000 .00000 
00.00000.00000 
00.00000.00000 
00 .00000 .00000 


.000 .A070 .795 
.000 .3A10 .738 
.000 .3A70 .709 
.000 .3070  .56 1 
.000 .A500 .93 1 
.000 .30A0.61 2 
000 .3560.72 1 
OOO .3100.637 
000.3160. 629 
000  .3010 .576 
.000 .3A20 .729 
000.3290.739 
000.3710 .690 
000.3360.673 


5.  RUN  NAME 

5.005  MULTIPLE  LINEAR  REGRESSION  ON  TANK 

10.  varialle  list 

10.005  Tbl ^TBS^PV, ER 
30.  INPUT  FORMAT 

30.005  FIXEDC2F6.3^ FA.3^F5.3) 

40.  NO.  OF  CASES 

40.005  13 

41.0  COMPUTE 

41.005  TB12=TB1+T£1 

44.0  COMPUTE 

44.005  TBl TbS«TBl *TBS 

46.0  COMPUTE 

46.005  TbS2*TBS*TBS 
50.  REGRESSION 

50.001  VARlABLES=TB12,TBlTES^TbS2,Tbl 

50.002  >TBS,PV,ER/ 

50.003  REGRESSI0N=PV  WITH  TB12,TBlTbS 

50.004  ,TfaS£,TBWTbS(2)/ 

50.005  REGRESSI0N=ER  WITH  TB12,TB1TBS 

50.006  ^TfcS2,Tfal*TBSC4) 


-1 .000-1 .000.6691 .635 
01  .000-1  .000.581 1 .315 
- I .0000  I .OCO .5381 .235 

01 .00001 .000. 4601 .021 
OO.OOCCC.000.5771  .337 
00.00000.000.5851 .380 
00.00000.000.581 1 .366 
00.00000.000.5731 .332 
00.00000.000.6091 .426 
-1 .41400.000.591 1.404 

01 .41400.000. 5181 .148 
00. OCO -1.4 14.61 71  .504 
00.00001 .414.5331 .092 


124 


APPENDIX  D 

This  appendix  contains  the  programs  necessary  for  the  adapted  In- 
teractive Vector  Maximal  algorithm.  The  first  program  is  an  interactive 
data  program  which  queries  the  decision  maker  for  necessary  data  and 
stores  that  data  in  a data  file.  Figure  18,  page  60,  is  an  example 
of  the  output  from  and  the  input  to  this  program.  The  program  allows 
a maximum  of  10  response  equations  and  5 independent  variables.  The 
coefficients  of  the  response  equations  are  input  in  the  following 
order : 


i 1,«.«»3, 

i = 2, 3. 4. 5, 


x^.  i = 3,4,5, 


X3.  1 = 4,5, 


^5’ 

x^  i — 1,...,5 

and  the  constant  term.  The  gradient  coefficients  are  input  as  x^,i  = 1 
,...,5,  and  the  constant  term.  The  region  of  interest  boundaries  are  the 
limits  on  the  region  of  experimentation  utilized  in  the  second  order  de- 
sign for  the  primary  or  all  response  functions.  The  limits  must  coincide 
to  prevent  extrapolation  of  an  equation  outside  its  region  of  experiment- 
ation. During  optimization,  these  limits  will  not  be  exceeded,  thus 
preventing  extrapolation.  The  second  program  is  an  Interactive  program 
which  utilizes  input  from  both  the  first  program  of  this  appendix  and 
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from  the  decision  maker  to  perform  iterations  of  the  adapted  Interactive 
Vector  Maximal  algorithm.  Figure  19,  page  6i , is  an  example  of  the 
output  from  and  the  input  to  this  second  program. 

Within  the  program,  ZX3LP  is  called  as  a subroutine.  This  sub- 
routine is  part  of  the  IMSL  library  available  on  the  Georgia  Tech  CDC 
CYBER  74.  The  library  subroutine  ZX3LP  accepts  input  for  a linear  pro- 
gramming optimization  problem  and  utilizes  the  simplex  method  to  optimize 
the  problem.  Also  utilized  in  conjunction  with  the  second  program  of 
this  appendix  is  the  Bazaraa  Cyclic  Coordinate  Algorithm  for  Optimizing 
Penalty  Functions  computer  program  (5)  available  in  the  Georgia  Tech 
ISyE  computer  library.  If  the  boundary  definitions  of  the  suboptimiza- 
tion problem  are  nonlinear,  the  second  program  of  this  appendix  terminates 
after  outputing  the  objective  function  coefficients  of  the  suboptimiza- 
tion problem.  The  Bazaraa  program  is  then  utilized  to  compute  the  opti- 
mum search  direction.  This  new  direction  is  then  input  back  into  the 
main  program. 
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C 

C*****THIS  PR0GRAM  INPUTS  DATA  INT0  A DATA  FILE  F0R 
C*****:0PT1MIZATI0N  BY  THE  INTERACTIVE  VECT0R  MAXIMAL 
C4c4i)|^«*ALG0RlTHM. 

C 

PR0GRAM  DATAPR0( INPUTS 0UTPUT^  TAPE3* TAPE5-I NPUT, TAPE6*) 

♦0UTPUT) 

DIMEN5I0N  X(5}^R£Q( 1C«21>«NAME(1O>/REQG(5O/6}«B0UN(5^2>«  ' 

1SA(50>5),S&(50)  I 

WRITE  (6/ 100)  i 

100  FORMAT  (♦INPUT  NUMBER  0F  RESPONSE  EfiUATIONS^) 

READ  (5«^>NREQ 

WRITE  (3^^)NRE0 
WRITE  (6^ 101 ) 

101  FORMAT  (♦INPUT  NUMBER  0F  INDEPENDENT  VARIABLES  (X”S)^) 

READ  (5«^)NX 

WRITE  (3/^)NX 
WRITE  (6^102) 

102  FORMAT  (♦INPUT  INITIAL  VALUE  OF  INDEPENDENT  VARIABLES 
♦WITH  . AND 

!>♦) 

READ  (5^^)(X(IX),IX=1,NX) 

WRITE  (3,^)(X(IX),IX=1,NX) 

DO  301  IM=1 «NR£fi 
WRITE  (6^103)  IM 

103  FORMAT  (♦INPUT  COEFFICIENTS  OF  RESPONSE  ECUATI ON^, 12 ) 

READ  (5/^)(REQ(  IM,  IC)^  1C-U21  ) 

WRITE  (3,^)(REQ(IM>IC),IC=1,21) 

301  CONTINUE 

WRITE  (6,107) 

107  FORMAT  (♦INPUT  RESPONSE  EQUATION  NAMES  IN  GROUPS  OF  TEN 
♦LETTERS^/ 

l^AND  SPACES,  RIGHT  JUSTIFIED,  ONE  PER  LINE^) 

READ  ( 5, 108 ) (NAME( IN), IN«1 ,NREQ) 

WRITE  (3, 108)(NAME( IN), IN*1,NREQ) 

108  FORMAT  (AlO) 

DO  312  IFb1,NREQ 

DO  313  JX«1,5  ; 

WRITE  (6, 1 1 6)  IF, JX  ’ 

116  FORMAT  (♦INPUT  COEFFICIENTS  OF  GRADIENT  £♦, 1 2, ♦X^,  1 2 ) 

READ  (5,^)(REQG(JC,KC),KC«1 ,6) 

WRITE  (3,^)(REQG(JC,KC),KC-1,6) 

JC=JC+1 

313  CONTINUE 
312  CONTINUE 

WRITE  ( 6, 1 lA) 

llA  FORMAT  (♦INPUT  REGION  OF  INTEREST  BOUNDARY  DEFINITION,  I ■ 

♦FOR^/  I 

1 ♦INTEGER,  L FOR  LINEAR,  OR  N FOR  NONLINEAR^)  ] 

READ  (5,115)  NB0N 


L J 
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WRITE  <3,-115}NB0N 
115  F0RMAT  <a:) 

IF  CNb0N.FQ. IHl ) G0T0  210 
IF  (NB0N.EQ.1HL>  G0T0  231 
IF  (NB0N.EW.1HN>  G0T0  232 
210  D0  319  KB>1^NX 
WRITE  (6^ 1 17>KB 

117  F0ftMAT  (♦INPUT  L0WER  AND  UPPER  B0UNDS  0F  X^#ll> 

R£AD( 5^ ♦ } ( B0UN( KB«  LB ) « LB» 1 ^ 2 > 

WRITE  (3«^)  (B0UN(KB«LB)^LBsW2) 

319  CONTINUE 
(j0T0  232 

231  WRITE  (6, 135) 

135  format  (♦input  NUMBER  0F  LESS  THAN  0R  EQUAL  C0NSTRA1 NTS^) 
READ  (5«^>M1 

WRITE  (3,^)M1 
WRITE  (6* 136) 

136  FORMAT  (♦INPUT  NUMBER  OF  EQUALITY  CONSTRAINTS^ ) 

READ  (5,^)M2 

WRITE  (3^^)M2 
IAS=M1+M2+2 
WRITE  (3^^)IAS 
IF  (Ml.EQ.O)  GOTO  330 
DO  330  IMI-I^MI 
WRITE  (6> 137)NX, IMl 

137  FORMAT  (♦INPUT  ♦, 1 1 , ♦ COEFFICIENTS  OF  LESS  THAN 
♦CONSTRAINTS^ 12) 

READ  (5^S)(SA(lMi,JMl  ),  JM1=UNX) 

WRITE  (3«S)  (SA(  IMl  « JMl  )«UM1  « WNX) 

330  CONTINUE 

IF  (M2.EQ.0)  GOTO  331 
DO  331  1M2:>UM2 
WRITE  (6« 138>NX/ 1M2 

138  FORMAT  (SlNPUT  s^Il/S  COEFFICIENTS  OF  EQUALITY  CONSTRAINT 
♦♦^12) 

READ  (5>s)( SA( (M1SIM2 )«UM2)« JM2»1>NX) 

WRITE  (3>S)(SA( (Ml +IM2),JM2)^ JM2«1#NX) 

331  CONTINUE 
ISB«M1 *H2 
WRITE  (6/139) 

139  FORMAT  (SlNPUT  RHS  OF  CONSTRAINTS  AS  INPUT  AB0VES) 

READ  (5/S)(SB(JSB)/JSB»l/lSB) 

WRITE  (3/S)(SB(JSB)/USB»l /ISB) 

GOTO  232 

232  ENDFILE  3 
REWIND  3 
STOP 
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C*****ADAPTED  interactive  VECT0R  MAXIMAL  0PTIMI2ATI0N 
C««««*ALG0R1THM. 

C 

PR0GRAM  0PTIMIZ(  INPUT, 0UTPUT^ TAPE3, TAPE5»I NPUT^ TAPE6  = 
♦0UTPUT) 

OIMENSI0N  SEC  1 0 > , SYC 1 0 ) , VC  1 0 > , DEC  10,20), EEC  1 0 ) , NA^EC 1 0 ) , 
*GC20>, 

1R£Q6C50,6>,REQJC  10, 5}  , VG  C 5 ) ,B0UNC  5, 2 ) , DC  5)  , EC  10),REQC  10, 
*21  ), 

1XC5),YC5),  ZC5),SAC5O,5),SBC5O),PS0LC5),DS0LC5O),RW<265O) 
*, IWC 172) 

D0  305  11=1,5 
X(II)=0. 

305  C0NTINUE 
VC  1 ) = 1 . 

c 

C*****THIS  SECTI0N  READS  INPUT  DATA  FR0M  A DATA  FILE. 

C 

READ  C3,*)NREQ 
READ  C3,*)NX 

READ  C3,*)CXC IX),IX=1,NX) 

D0  301  IM=1,NREQ 

READ  C3,*)CREQCIM,IC),IC«1,21) 

301  C0NTINUE 

READ  C3, 1081 )CNAMEC IN), IN»1 ,NREQ) 

1081  E0RMAT  CAIO)  , 

JC  = 1 

D0  312  IE=1,NREQ 
D0  313  JX=1,5 

READ  C3,*)CREQGC  JC,KC  ),KC=1 ,6) 

0C=UC+ 1 

313  CONTINUE 
312  CONTINUE 

READ  C3, 1 151 )N£0N 
1151  FORMAT  CAD 


IF 

CNB0N.EQ. IHL) 

GOTO 

233 

IF 

CNE0N.EQ.1H1) 

GOTO 

234 

IF 

CNEON.EG. IHN) 

GOTO 

215 

234 

DO 

319  K£-1,NX 

READ  C3,*)CB0UNCKB,L6),LB=1,2) 

319  CONTINUE 
G0T0  215 
C 

C*****THIS  SECTION  PRESENTS  THE  DECISION  MAKER  VITH 
♦ALTERNATIVF.S 

C*****AND  READS  HIS  TRADEOFF  INPUTS. 

C 

233  READ  (3,*)M1 
READ  C3,*)M2 
READ  C3,*)IAS 
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1SBSM1-I-M2 
D0  332  ISA-UISB 

READ  (3«*}(SA( ISA«JSA)^JSA>1«NX> 

332  C0NT1NUE 

READ  <3#*)<SB( JSB)/JSB«=U  ISB) 

G0T0  215 

215  CALL  REQEV(NREQ,F,NX,REQ,X> 

D0  32A  MS^^UNREQ 
SF(MS)=F(MS) 

324  C0NTINUE 
JC»1 
LC  = 1 
L»1 

WRITE  (6, 104) 

104  F0RMAT  C+INPUT  PERTURBATION  0F  FCl)^  IN  FAVORABLE 
♦DIRECTION*) 

READ  <S^*)DF0NE 
BB(1)»F< 1 )+DF0NE 
DO  308  JBs2^NR£Q 
BBC JB)aF< JB) 

306  CONTINUE 

DO  307  KT-2>NREQ 
WRITE  C6^ 105)KT 

105  FORMAT  C*INPUT  PERTURBATION  OF  F(**I2,*)*  IN  FAVORABLE 
♦DIRECTION*) 

READ  C5**)DFCKT, L) 

204  IF  (KT.EQ.2)  GOTO  200 
BBCKT-1 )»FCKT-1 ) 

200  BB(KT)«>FCKT)-DF<KT^  L) 

WRITE  C6, 106) 

106  FORMAT  (25X^1 HA«16X«1HB) 

00  309  NW»1«NREQ 

WRITE  C6« 109)NAMECNW)«F(NW)/BBCNW) 

109  format  (A10« 10X^F10.5>5X«F10.5) 

309  CONTINUE 

WRITE  C6« 1 10) 

C 

C*****THIS  SECTION  ADJUSTS  THE  ALTERNATIVES  PRESENTED  TO 
C*****THE  DECISION  MAKER  UNTIL  HE  IS  INDIFFERENT, 

C 

110  FORMAT  C*WHICH  DO  YOU  PREFER.  IF  YOU  ARE  INDIFFERENT 
♦TYPE  I.*) 

READ  (5^111)NDEC 

1 1 1 FORMAT  (A1 ) 

IF  CNDEC.EQ.IHI ) GOTO  201 
IF  CNDEC.EQ.IHA)  GOTO  202 
DF(KT,L+1 )«2*DFCKT, L) 

L=L+1 
GOTO  204 

206  WRITE  C6..106) 


BBC  KT) «F<  KT) -DF(KT, L) 

D0  310  JV-l/NREQ 

WRITE  ibj 109>NAHE(JW>«F( JV}«BB( JV) 

310  CONTINUE 
WRITE  (6, 110) 

READ  (5< 1 1 1 )NDEC 

IF  (NDEC.ECk.lHA)  GOTO  203 
If  (NDEC.EQ.1HB)  goto  208 
GOTO  201 

202  G(L)=DF(KT,L) 

203  0F(KT/L+1 ) =DF< KT, L) -(G(L)/2 . ) 

G<L+1 )«G(L)/2. 

L*L+1 
GOTO  206 

208  DF(KT,L+1 ) «DF( KT, L) ♦( G ( L) /2 . ) 

G(L+1 )*G<L)/2  . 

L=L+1 
GOTO  206 
C 

C#***>kTH1S  section  computes  the  TRADEOFF  VALUES. 

C 

201  W(KT)»(DF0NE)/(DF(KT^L)) 

30  7 CONTINUE 

WRITE  (6> 112) 

112  FORMAT  <*THE  TRADEOFFS  ARE») 

DO  311  LT=UNREQ 

WRITE  (6# 1 13)NAME(LT)^W(LT) 

113  FORMAT  (AlO, lOX.FlO.S) 

311  CONTINUE 
C 

C*»***THIS  SECTION  COMPUTES  THE  COEFFICIENTS  OF  THE 
C*»***SUB0PTIMI2ATI0N  OBJECTIVE  FUNCTION. 

C 

DO  314  IJ=1«NREQ 
DO  315  JJ»U5 

E-0. 

DO  316  JSbUNX 
E=E+{BEQG(LC^ JS))4XCJS) 

316  CONTINUE 

REQJ(  IJ^JJ)  »£•«•(  REQG(LC«  6)  ) 

LC*LC+1 

315  CONTINUE 
314  CONTINUE 

DO  317  KW-UNX 
VG(KW)>0. 

DO  318  LW-1«NREQ 

WG(KW)«WG(KW)-KW<LW)*REQJ(LW,KW)  ) 

318  CONTINUE 

WRITE  (6,*)WG(KW) 

317  CONTINUE 
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D0  rilV  = l«NX 
WRITE  i6,*i  VGdlV) 

1 CONTINUE 

C 

C*****THIS  SECTION  PERFORMS  THE  SUBOPTIMIZATION. 

C 

IF  <NB0N.EQ.1HI)  CALL  SINT< Y, WG*B0UN/NX) 

IF  (NBON.EQ.IHL)  CALL  ZX3LP< SA, 50, SB,WG> NX, Ml  * M2> S> Y 
1DS0L,RV, IW, lER) 

IF  (NB0N.EG. IHN)  CALL  NLP<Y,NX),  RETURNSC 2 1 4, 999 ) 

214  DO  321  1D»1,NX 

D< ID)=Y( ID)-X< ID) 

321  CONTINUE 
WRITE  (6,118) 

118  FORMAT  (♦NEW  DECISION  VECTOR^) 

DO  322  UDsl,NX 

WRITE  (6, 119)JD,Y(UD) 

119  FORMAT  (♦Y+,I1,5X,F10.5) 

322  CONTINUE 
WRITE  (6,120) 

120  FORMAT  (♦NEW  OPERATING  POINTS) 

CALL  REQEV(NREQ, F,NX,REQ,Y) 

DO  323  JY-J,NREO 
WRITE  (6,121)  F(IY) 

121  format  (F10.5) 

323  CONTINUE 
WRITE  (6,122) 

C 

C^^^^^THIS  SECTION  PERFORMS  THE  STEP-SIZE  OPTIMIZATION. 

C 

122  FORMAT  (♦INPUT  NUMBER  OF  POINTS  TO  SEE  IN  STEP  SIZE^) 
READ  (5,^)KS 

T=1 ./(KS-1 ) 

DO  325  NS«1,NREQ 
SY(NS)*F(NS) 

325  CONTINUE 

WRITE  (6, 123)(SF(MW),MW«1 ,NREQ) 

123  FORMAT  ( 5F 1 2 .4/5X, 5F 1 2 .4 ) 

KZ»KS-2 

DO  326  MT«1,KZ 
DO  327  MX»1,NX 
Z(MX)»X(MX)+(T^MT^D(MX) ) 

327  CONTINUE 

CALI  REQEV(NREQ,F,NX, REQ,Z) 

WRITE  (6, 123)(F(HZ),MZ«1,NREQ) 

326  CONTINUE 

WRITE  (6, 123)(SY(MY),MY“1,NREQ) 

WRITE  (6,124) 

124  FORMAT  (♦INPUT  NUMBER  OF  PBEFFERED  POINTS) 

READ  (5,^)MN 
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D0  32o  NN-1«NX 

X(NN>-X(NN>f(D(NN>*T«(MN-l > > 

328  CeNTlNUE 

WRITE  (6>125> 

125  F0RMAT  (♦IF  Y0U  WISH  T0  TERMINATE  TYPE  T.  0THERWISE^ 
♦TYPE  C.^) 

READ  (5^130)NTER  , 

130  FORMAT  (Al) 

IF  (NTER.Efi. IHC)  G0T0  215 
WRITE  (6«  126}(X(M0>«M0»UNX} 

126  FORMAT  (♦OPTIMAL  X^/5F12.4) 

999  STOP 

END 

C 

C^^^^^THIS  SUBROUTINE  EVALUATES  THE  RESPONSE  EQUATIONS. 

C 

SUBROUTINE  REQEV(NREQ^  F#NX,REQ^X) 

DIMENSION  F( 10}4R£Q( 10^21 >«X(5} 

DO  300  JT*1,NREQ 
F(JT)=0. 

DO  302  1S=WNX 

F(  JT)«F(JT>'*-(REQ(  JT,  I S>  ) ♦( X(  I S ) ♦♦B  ) 

302  CONTINUE 

DO  303  IA«2>NX 

F(  JT)»:F(  JT)^(REQ(JT,  lA+A)  ^♦(X(  1 ^♦X(  lA)  ) 

303  -CONTINUE 

DO  304  IB=3«NX 

F(t;T)»F(  JT)+(REC(UT^  IB+7)  )^(X(2)^X(  IB)  ) 

304  CONTINUE 

F(  JT)  =F(  JT)>(REQ(iJT>  1 3 ) ) ♦ (X(  3 )^X ( 4 ) ) ♦(  REQ(  JT,  14)  )^(X(3) 
♦♦X( 5) ) 

F(  JT)=F(  JT)-KREQ(  JT,  1 5)  )^(X(4)^X(  5)  ) 

DO  306  10«1,NX 

F( JT)=F( JT)+(REQ( JT, 10>15)^X( I0) ) 

306  CONTINUE 

F(  JT)=F(  JT)+REQ(  JT,21  ) 

300  CONTINUE 
RETURN 
END 
C 

C^^^^^THIS  SUBROUTINE  PERFORMS  THE  SUBOPTIMIZATION  FOR 
C^^^^^InTEGER  REGION  OF  E)(PERIMENTATI0N  BOUNDARIES. 

C 

SUBROUTINE  SINT( Y, WG,BOUN,NX) 

DIMENSION  Y(S),WG(S),B0UN(5,2) 

DO  320  IP3l,NX 
Y(IP)=«0. 

IF  (WG( IP) .LT.O.)  Y(IP)-B0UN(IP, 1) 

IF  ( WG( IP) .GT.O. ) Y(IP>-B0UN( IP,2) 

320  CONTINUE 
RETURN 
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END 

C 

C****»THIS  SUBR0UTINE  R0UTES  THE  PR0GRAM  T0  THE  PR0GRAM 
C««4<««F0R  the  SUB0PT1M1EATI0N  0F  N0NL1NEAR  REG10N  0F 
C*****EXPERIMENTATI0N  B0UNDAR1ES. 

C 

SUBR0UT1NE  NLPCY,NX),  RETURNS( AAAj BBB) 

D1MENSI0N  YC5) 

WRITE  (6^140) 

140  F0RMAT  (*1F  Y0U  D0  N0T  HAVE  Y,  INPUT  N0,  0THERW1SE  YES*) 
READ  C5* 145) ITER 
145  FORMAT  (A2) 

IF  (ITER.EQ.2HN0)  RETURN  BBB 
WRITE  (6,150) 

150  FORMAT  (♦INPUT  VALUES  0F  Y*) 

READ  (5,*)(Y(1),I=1,2) 

RETURN  AAA 
END 
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APPENDIX  E 

In  keeping  with  the  hypothetical  nature  of  Chapter  IV,  Equation 
4,26,  4.27  and  4.28  were  not  actually  obtained  from  TRADOC.  An  interview 
was  conducted  with  Armor  officers  studying  Operations  Research  at  Georgia 
Tech.  To  insure  commonality  of  Independent  variables  for  all  response 
equations,  time  to  fire  the  first  round  and  time  between  rounds  were 
treated  as  independent  variables  in  the  interview  with  trainings  hours 
and  training  rounds  as  dependent  variables. 

Initially  an  attempt  was  made  to  fit  second  order  equations  to 
the  training  responses  in  the  optimum  region  of  experimentation  of 
Equations  4.24  and  4.25.  A statistically  satisfactory  fit  was  not  pos- 
sible in  the  optimum  region  of  experimentation.  A first  order  approxi-  | 

mation  in  the  optimum  region  of  experimentation  to  the  training  curves  i 


was  then  fit  by  use  of  the  SPSS  regression  program.  The  input  to  the 
program  was: 
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The  SPSS  output  is  found  on  the  next  page  of  this  Appendix,  y^  on  top 

y,  at  the  bottom. 

4 

The  SPSS  output  yielded  the  following  two  response  equations, 
y^  * -11.5xj^-6.5x2  + 33.2 
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